-- Logs begin at Wed 2022-08-31 18:26:37 UTC, end at Wed 2022-08-31 19:49:58 UTC. -- Aug 31 19:03:46.029561 dv-cinder-835384-26-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 31 19:03:46.038301 dv-cinder-835384-26-iscsi devstack@n-api.service[105610]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 31 19:03:46.040319 dv-cinder-835384-26-iscsi devstack@n-api.service[105610]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 19:03:46 2022] *** Aug 31 19:03:46.040319 dv-cinder-835384-26-iscsi devstack@n-api.service[105610]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 19:03:46.040319 dv-cinder-835384-26-iscsi devstack@n-api.service[105610]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 19:03:46.040319 dv-cinder-835384-26-iscsi devstack@n-api.service[105610]: nodename: dv-cinder-835384-26-iscsi Aug 31 19:03:46.040319 dv-cinder-835384-26-iscsi devstack@n-api.service[105610]: machine: x86_64 Aug 31 19:03:46.040319 dv-cinder-835384-26-iscsi devstack@n-api.service[105610]: clock source: unix Aug 31 19:03:46.040319 dv-cinder-835384-26-iscsi devstack@n-api.service[105610]: pcre jit disabled Aug 31 19:03:46.040319 dv-cinder-835384-26-iscsi devstack@n-api.service[105610]: detected number of CPU cores: 4 Aug 31 19:03:46.040319 dv-cinder-835384-26-iscsi devstack@n-api.service[105610]: current working directory: / Aug 31 19:03:46.040319 dv-cinder-835384-26-iscsi devstack@n-api.service[105610]: detected binary path: /usr/bin/uwsgi-core Aug 31 19:03:46.040319 dv-cinder-835384-26-iscsi devstack@n-api.service[105610]: your processes number limit is 47680 Aug 31 19:03:46.040319 dv-cinder-835384-26-iscsi devstack@n-api.service[105610]: your memory page size is 4096 bytes Aug 31 19:03:46.040319 dv-cinder-835384-26-iscsi devstack@n-api.service[105610]: detected max file descriptor number: 2048 Aug 31 19:03:46.040319 dv-cinder-835384-26-iscsi devstack@n-api.service[105610]: lock engine: pthread robust mutexes Aug 31 19:03:46.041850 dv-cinder-835384-26-iscsi devstack@n-api.service[105610]: thunder lock: enabled Aug 31 19:03:46.041850 dv-cinder-835384-26-iscsi devstack@n-api.service[105610]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 31 19:03:46.041850 dv-cinder-835384-26-iscsi devstack@n-api.service[105610]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 19:03:46.079949 dv-cinder-835384-26-iscsi devstack@n-api.service[105610]: Python main interpreter initialized at 0x56408fddc9c0 Aug 31 19:03:46.079949 dv-cinder-835384-26-iscsi devstack@n-api.service[105610]: python threads support enabled Aug 31 19:03:46.079949 dv-cinder-835384-26-iscsi devstack@n-api.service[105610]: your server socket listen backlog is limited to 100 connections Aug 31 19:03:46.079949 dv-cinder-835384-26-iscsi devstack@n-api.service[105610]: your mercy for graceful operations on workers is 90 seconds Aug 31 19:03:46.080296 dv-cinder-835384-26-iscsi devstack@n-api.service[105610]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 19:03:46.080379 dv-cinder-835384-26-iscsi devstack@n-api.service[105610]: *** Operational MODE: preforking *** Aug 31 19:03:46.080612 dv-cinder-835384-26-iscsi devstack@n-api.service[105610]: *** uWSGI is running in multiple interpreter mode *** Aug 31 19:03:46.080612 dv-cinder-835384-26-iscsi devstack@n-api.service[105610]: spawned uWSGI master process (pid: 105610) Aug 31 19:03:46.080794 dv-cinder-835384-26-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 31 19:03:46.082153 dv-cinder-835384-26-iscsi devstack@n-api.service[105610]: spawned uWSGI worker 1 (pid: 105611, cores: 1) Aug 31 19:03:46.082153 dv-cinder-835384-26-iscsi devstack@n-api.service[105610]: spawned uWSGI worker 2 (pid: 105612, cores: 1) Aug 31 19:03:46.082153 dv-cinder-835384-26-iscsi devstack@n-api.service[105610]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 19:03:46.736861 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 19:03:46.762394 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 19:03:47.827275 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 19:03:47.827275 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: from cryptography.utils import int_from_bytes Aug 31 19:03:47.827921 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 19:03:47.827921 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: from cryptography.utils import int_from_bytes Aug 31 19:03:47.842765 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 19:03:47.842765 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: from cryptography.utils import int_from_bytes Aug 31 19:03:47.843233 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 19:03:47.843233 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: from cryptography.utils import int_from_bytes Aug 31 19:03:50.303130 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 19:03:50.303695 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 19:03:50.303890 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 19:03:50.304152 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 19:03:50.304509 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 19:03:50.304591 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 19:03:50.304687 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 19:03:50.304844 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.304931 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 19:03:50.305167 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.305279 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 19:03:50.305509 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.305597 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 19:03:50.305826 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.305914 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.306152 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.306250 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.306493 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.306588 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.306808 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.306904 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.307122 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.307217 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.307442 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.307535 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.307696 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.307781 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.308006 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.308093 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.308324 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835384-26-iscsi {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.308417 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.308634 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.308729 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.308934 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.309019 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.309258 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.309345 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835384-26-iscsi {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.309580 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.309676 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.309878 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.309964 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.310189 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.310279 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.310486 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.310583 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.310797 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.310977 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.311119 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.311417 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.311530 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.311719 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.311914 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.312037 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.312228 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.312340 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.312532 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.312639 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.312844 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.312951 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.313195 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.313285 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.313519 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.313607 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.313828 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.313914 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.314149 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.314231 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.314459 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.314546 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835384-26-iscsi {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.314783 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.314918 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.315094 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.315187 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.315435 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.315519 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835384-26-iscsi {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.315793 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.315885 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.316105 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.316189 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.316419 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.316559 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.316732 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.316817 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.317050 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.317143 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.317380 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.317470 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.317703 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.317801 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.318018 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.318113 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.318332 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.318462 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.318646 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.318732 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.318944 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.319038 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.319249 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.319335 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.319558 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.319643 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.319874 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.320001 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.320176 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.320313 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.320474 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.320561 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.320719 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.320806 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.321026 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.321117 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.321379 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.321479 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.321629 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.321728 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.321941 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.322062 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.322287 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.322384 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.322542 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.322628 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.322874 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.323020 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.323161 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.323258 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.323410 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.323497 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.323730 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.323822 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.324045 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.324130 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.324348 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.324433 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.324649 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.324735 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.324952 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.325043 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.325277 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.325377 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.325582 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.325685 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.325887 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.325971 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.326193 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.326278 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.326500 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.326601 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.326801 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.326896 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.327117 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.327202 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.327438 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.327530 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.327741 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.327825 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.328045 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.328130 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.328377 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.328477 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.328679 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.328803 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.328980 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.329063 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.329315 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.329415 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.329636 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.329731 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.329956 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.330087 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.330239 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.330325 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.330541 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.330637 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.330854 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.330938 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.331176 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.331261 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.331474 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.331558 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.331716 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.331800 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.332009 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.332095 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.332309 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.332403 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.332620 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.332705 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.332919 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.333005 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.333239 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.333328 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.333545 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.333639 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.333839 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.333923 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.334143 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.334227 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.334442 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.334534 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.334742 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.334832 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.335040 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.335132 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.335341 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.335438 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.335638 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.335722 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.335937 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.336021 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.336239 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.336336 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.336536 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.336627 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.336843 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.336926 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.337150 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.337322 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.337478 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.338064 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.338313 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.338399 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.338618 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.338756 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.338921 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.339009 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.339233 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.339316 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.339534 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.339620 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.339840 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.339937 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.340156 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.340238 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.340457 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.340592 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.340757 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.340849 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.341069 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.341161 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.341397 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.341485 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.341701 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.341785 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.342011 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.342094 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.342306 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.342392 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.342608 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.342694 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.342919 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.343012 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.343220 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.343304 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.343519 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.343610 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.343815 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.343900 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.344112 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.344198 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.344408 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.344492 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.344704 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.344799 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.345001 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.345086 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.345320 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.345409 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.345616 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.345716 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.345916 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.346000 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.346219 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.346304 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.346518 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.346615 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.346817 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.346901 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.347116 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.347201 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.347430 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.347526 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.347740 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.347824 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.348049 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.348134 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.348371 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:50.348466 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.348690 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.348816 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.349017 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.349112 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.349368 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.349454 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.349685 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.349770 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.349998 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.350082 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.350308 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.350394 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.350630 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.350717 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.350936 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.351020 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.351241 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.351327 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.351548 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.351632 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.351863 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.351955 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.352173 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.352257 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.352488 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.352571 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.352795 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.352888 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.353105 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.353285 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.354012 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.354103 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.354324 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.354427 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.354640 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.354726 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.354958 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.355043 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.355272 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.355366 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.355577 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.355660 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.355906 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.355990 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.356231 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.356325 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.356542 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.356627 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.356862 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.356948 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.357180 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.357331 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.357509 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.357606 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.357815 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.357901 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.358120 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.358206 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.358439 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.358524 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.358749 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.358839 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.359060 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.359149 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.359373 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.359465 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.359684 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.359778 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.360004 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.360089 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.360313 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.360398 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.360620 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.360740 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.360930 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.361023 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.361266 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.361353 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.361574 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.361739 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.361887 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.361979 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.362199 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.362283 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.362510 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.362607 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.362818 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.362913 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.363129 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.363214 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.363443 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.363536 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.363755 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.363846 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.364064 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.364149 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.364372 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.364465 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.364674 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.364758 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.364976 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.365060 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.365300 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.365405 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.365609 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.365695 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.365910 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.365995 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.366213 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.366299 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.366524 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.366618 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.366825 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.366910 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.367146 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.367231 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.367446 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.367530 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.367753 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.367855 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.368060 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.368147 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.368364 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.368450 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.368664 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.368749 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.369011 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.369140 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.369354 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.369486 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.369649 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.369743 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.369961 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.370052 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.370270 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.370353 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.370572 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.370668 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.370894 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.370983 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.371194 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.371278 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.371495 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.371588 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.371803 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.371888 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.372110 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.372201 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.372415 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.372512 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.372723 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.372808 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.373318 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.373409 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.373639 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.373731 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.373947 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.374039 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.374255 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.374351 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.374575 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.374659 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.374891 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.374975 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.375189 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.375272 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.375507 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.375604 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.375830 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.375914 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.376136 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.376219 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.376434 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.376531 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.376738 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.376823 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.377038 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.377131 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.377359 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.377446 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.377660 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.377743 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.377964 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.378061 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.378263 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.378349 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.378560 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.378644 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.378857 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.378954 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.379155 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.379241 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.379453 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.379553 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.379753 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.379844 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.380059 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.380150 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.380358 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.380442 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.380655 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.380741 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.380953 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.381045 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.381288 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.381388 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.381594 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.381681 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.381898 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.382028 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.382242 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.382327 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.382550 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.382636 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.382864 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.382948 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.383176 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.383261 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.383487 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.383573 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.383792 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.383876 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.384098 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.384191 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.384406 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.384523 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.384761 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.384847 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.385076 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.385172 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.385408 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.385495 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.385719 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.385802 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.386023 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.386115 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.386339 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.386422 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.386643 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.386727 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.386958 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.387052 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.387258 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.387349 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.387571 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.387663 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.387891 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.387986 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.388196 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.388281 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.388512 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.388596 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.388826 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.388911 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.389243 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.389342 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.389469 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.389554 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.389775 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.389870 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.390089 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.390174 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.390395 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.390481 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.390703 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.390791 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.391014 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.391098 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.391319 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.391402 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.391629 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.391729 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.391934 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.392018 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.392249 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.392341 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.392553 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.392638 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.392864 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.392948 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.393165 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.393329 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.393497 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.393590 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.393820 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.393911 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.394128 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.394222 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.394436 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.394520 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.394762 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.394846 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.395097 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.395191 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.395409 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.395495 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.395723 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.395807 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.396036 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.396122 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.396338 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.396430 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.396639 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.396725 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.396946 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.397030 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.397278 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.397366 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.397586 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.397670 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.397891 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.397977 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.398192 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.398289 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.398500 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.398585 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.398802 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.398892 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.399102 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.399187 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.399401 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.399503 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.399709 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.399793 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.400011 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.400096 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.400844 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.400938 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.401161 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.401263 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.401509 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.401594 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.401823 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.401920 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.402147 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.402232 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.402471 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.402564 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.402778 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.402877 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.403085 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.403173 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.403393 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.403484 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.403697 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.403795 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.404004 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.404098 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.404309 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.404396 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.404614 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.404699 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.404927 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.405011 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.405272 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.405387 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.405581 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.405675 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.405891 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.405976 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.406199 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.406283 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.406504 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.406591 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.406815 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.406908 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.407124 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.407209 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.407429 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.407516 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.407737 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.407822 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.408045 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.408144 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.408354 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.408439 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.408662 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.408754 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.408972 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.409065 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.409310 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.409398 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.409628 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.409713 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.409952 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.410053 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.410251 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.410342 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.410559 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.410651 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.410868 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.410965 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.411173 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.411425 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.411521 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.411754 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.411849 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.412067 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.412337 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.412422 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.412674 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.412760 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.412994 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.413079 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.413342 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.413444 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.413669 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.413756 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.413980 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.414075 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.414281 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.414379 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.414586 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.414671 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.414888 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.414974 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.415189 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.415284 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.415494 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.415580 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.415846 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.415932 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.416649 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.416736 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.416951 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.417045 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.417280 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.417369 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.417581 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.417674 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.417881 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.417966 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.418181 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.418268 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.418483 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.418568 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.418789 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.418873 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.419087 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.419184 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.419390 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.419477 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.419688 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.419772 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.419997 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.420089 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.420302 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.420386 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.420601 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.420686 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.420901 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.421042 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.421208 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.421296 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.421529 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.421612 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.421833 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.421938 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.422138 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.422224 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.422481 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.422565 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.422787 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.422872 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.423104 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.423188 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.423405 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.423490 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.423724 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.423810 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.424024 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.424109 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.424325 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.424411 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.424625 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.424711 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.424929 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.425014 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.425256 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.425362 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.425560 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.425652 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.425865 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.425987 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.426173 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.426270 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.426475 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.426571 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.426779 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.426863 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.427078 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.427170 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.427382 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.427468 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.427682 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.427767 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.427981 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.428074 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.428284 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.428375 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.428583 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.428668 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.428881 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.428975 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.429216 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.429305 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.429509 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.429597 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.429809 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.429903 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.430116 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.430200 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.430413 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.430497 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.430718 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.430803 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.431016 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.431100 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.431338 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.431428 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.431664 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.431967 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.432065 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.432273 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.432366 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.432577 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.432681 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.432879 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.432984 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.433193 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.433280 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.433516 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.433603 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.433819 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.433903 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.434119 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.434204 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.434425 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.434511 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.434725 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.434817 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.435023 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.435114 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.435324 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.435410 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.435627 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.435712 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.435935 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.436021 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.436234 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.436330 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.436540 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.436626 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.436841 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.436936 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.437143 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.437258 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.437468 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.437555 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.437770 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.437863 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.438067 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.438159 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.438365 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.438452 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.438662 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.438758 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.438963 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.439049 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.439259 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.439344 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.439560 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.439657 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.439864 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.439949 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.440162 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.440246 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.440461 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.440552 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.440758 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.440843 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.441084 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.441168 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.441412 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.441505 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.441753 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.441837 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.442053 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.442137 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.442362 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.442448 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.442675 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.442760 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.442983 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.443068 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.443292 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.443387 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.443601 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.443699 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.443901 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.444063 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.444211 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.444295 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.444516 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.444601 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.444822 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.445008 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.445109 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.445220 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.445438 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.445524 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.445748 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.445845 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.446052 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.446138 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.446361 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.446445 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.446673 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.446767 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.447012 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.447108 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.447333 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.447468 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.447633 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.447719 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.447940 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.448025 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.448248 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.448342 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.448556 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.448647 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.448862 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.448946 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.449169 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.449301 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.449499 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.449586 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.449809 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.449892 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.450120 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.450203 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.450428 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.450513 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.450739 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.450825 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.451043 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.451128 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.451349 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.451442 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.451653 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.451745 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.451954 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.452046 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.452263 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.452355 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.452568 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.452653 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.452871 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.452966 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.453177 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.453292 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.453501 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.453586 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.453809 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.453909 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.454108 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.454193 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.454420 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.454532 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.454726 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.454844 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.455154 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.455247 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.455453 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.455545 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.455762 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.455849 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.456065 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.456148 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.456377 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.456459 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.456688 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.456780 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.456988 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.457072 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.457339 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.457436 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.457648 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.457740 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.458018 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.458102 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.458329 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.458414 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.458630 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.458715 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.458930 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.459016 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.459238 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.459332 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.459551 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.459634 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.459853 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.459936 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.460154 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.460248 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.460455 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.460540 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.460758 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.460842 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.461062 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.461162 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.461405 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.461501 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.461711 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.461851 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.462034 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.462121 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.462397 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.462480 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.463276 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.463371 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.463585 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.463672 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.463929 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.464012 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.464250 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.464342 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.464570 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.464675 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.464889 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.464976 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.465229 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.465331 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.465525 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.465618 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.465834 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.465920 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.466146 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.466231 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.466459 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.466551 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.466765 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.466858 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.467078 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.467171 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.467380 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.467473 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.467694 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.467788 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.468002 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.468087 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.468311 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.468409 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.468631 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.468718 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.468943 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.469026 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.469291 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.469436 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.469672 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.469763 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.469988 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.470074 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.470311 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.470405 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.470618 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.470704 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.470919 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.471004 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.471224 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.471326 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.471527 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.471612 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.471827 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.471955 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.472135 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.472221 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.472435 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.472519 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.472744 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.472830 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.473050 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.473135 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.473379 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.473467 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.473683 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.473770 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.473984 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.474071 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.474290 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.474374 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.474591 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.474683 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.474911 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.474997 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.475215 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.475300 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.475531 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.475623 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.475843 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.475927 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.476143 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.476227 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.476463 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.476562 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.476769 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.476854 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.477066 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.477150 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.477392 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.477491 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.477692 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.477787 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.477998 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.478090 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.478358 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.478450 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.478675 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.478760 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.478999 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.479084 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.479323 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.479409 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.479627 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.479717 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.479956 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.480051 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.480275 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.480361 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.480594 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.480678 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.480906 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.480992 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.481247 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.481338 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.481552 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.481637 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.481852 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.481956 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.482159 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.482252 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.482461 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.482554 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.482762 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.482860 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.483063 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.483156 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.483366 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.483450 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.483664 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.483797 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.483963 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.484051 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.484263 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.484349 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.484562 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.484659 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.484868 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.484960 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.485200 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.485325 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.485512 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.485599 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.485813 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.485908 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.486114 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.486200 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.486413 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.486499 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.486715 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.486801 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.487022 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.487107 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.487349 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.487434 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.487655 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.487741 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.487974 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.488061 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.488282 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.488368 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.488591 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.488683 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.488905 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.488999 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.489236 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.489327 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.489551 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.489637 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.489863 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.489965 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.490174 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.490261 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.490486 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.490570 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.490799 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.490967 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.491110 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.491196 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.491422 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.491513 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.491737 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.491934 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.492056 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.492261 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.492570 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.492654 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.492879 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.492965 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.493200 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.493299 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.493519 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.493613 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.493844 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.494450 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.494670 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.494765 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.494978 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.495064 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.495285 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.495417 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.495669 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.495756 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.495981 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.496074 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.496294 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.496380 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.496616 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.496736 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.496938 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.497032 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.497271 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.497370 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.497583 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.497670 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.498158 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.498259 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.498470 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.498563 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.498795 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.498880 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.499113 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.499201 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.499413 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.499498 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.499721 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.499816 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.500033 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.500118 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.500342 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.500463 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.500655 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.500750 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.500963 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.501049 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.501296 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.501385 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.501608 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.501705 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.501914 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.502001 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.502219 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.502305 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.502574 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.502683 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.502835 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.502921 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.503147 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.503231 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.503461 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.503548 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.503774 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.503869 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.504085 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.504181 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.504396 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.504484 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.504708 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.504794 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.505021 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.505239 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.505375 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.505555 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.505884 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.505969 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.506203 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.506296 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.506523 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.506609 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.506837 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.506923 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.507150 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.507249 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.507466 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.507551 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.507766 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.507857 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.508068 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.508162 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.508374 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.508461 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.508679 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.508764 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.508977 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.509072 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.509315 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.509402 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.510188 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.510288 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.510501 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.510590 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.510816 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.510902 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.511119 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.511216 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.511438 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.511648 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.511734 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.511988 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.512274 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.512362 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.512611 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.512697 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.512929 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.513013 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.513265 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.513366 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.513573 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.513661 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.513893 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.513985 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.514195 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.514289 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.514499 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.514598 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.514809 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.514895 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.515114 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.515209 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.515415 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.515507 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.515717 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.515813 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.516022 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.516116 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.516326 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.516411 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.516627 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.516713 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.516932 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.517032 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.517254 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.517343 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.517567 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.517652 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.517872 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.517958 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.518175 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.518260 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.518475 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.518560 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.518785 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.518878 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.519083 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.519168 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.519383 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.519470 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.519682 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.519776 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.519982 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.520068 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.520285 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.520369 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.520588 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.520724 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.520892 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.520979 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.521208 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.521310 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.521521 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.521607 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.521821 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.521907 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.522126 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.522221 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.522429 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.522519 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.522742 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.522828 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.523066 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.523159 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.523364 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.523451 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.523675 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.523768 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.523981 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.524077 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.524300 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.524387 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.524609 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.524695 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.524917 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.525012 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.525302 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.525392 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.525618 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.525741 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.525963 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.526145 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.526279 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.526476 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.526795 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.526886 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.527125 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.527219 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.527448 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.527534 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.527749 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.527833 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.528050 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.528137 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.528351 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.528443 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.528669 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.528831 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.528976 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.529069 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.529305 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.529395 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.529611 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.529710 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.529917 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.530002 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.530220 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.530314 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.530531 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.530629 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.530834 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.530927 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.531137 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.531224 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.531440 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.531538 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.531744 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.531832 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.532046 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.532139 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.532348 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.532436 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.532650 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.532736 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.532952 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.533044 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.533282 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.533384 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.533592 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.533677 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.533910 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.534005 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.534221 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.534305 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.534530 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.534624 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.534841 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.534935 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.535145 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.535231 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.535449 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.535539 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.535751 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.535890 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.536055 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.536140 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.536362 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.536446 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.536673 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.536766 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.536980 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.537064 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.537305 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.537394 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.537641 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.537727 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.537949 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.538035 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.538322 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.538406 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.538638 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.538725 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.538942 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.539035 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.539259 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.539344 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.539575 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.539662 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.539883 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.539969 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.540196 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.540290 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.540508 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.540600 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.541387 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.541487 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.541703 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.541800 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.542032 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.542117 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.542352 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.542444 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.542650 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.542749 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.542948 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.543034 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.543247 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.543333 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.543549 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.543636 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.543862 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.543954 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.544164 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.544249 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.544462 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.544548 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.544759 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.544844 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.545060 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.545146 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.545382 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.545471 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.545680 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.545772 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.545978 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.546073 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.546276 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.546362 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.546579 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.546672 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.546875 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.546968 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.547172 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.547295 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.547468 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.547597 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.547766 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.547862 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.548063 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.548149 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.548362 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.548447 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.548664 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.548757 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.548960 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.549046 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.549280 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.549381 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.549580 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.549667 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.549876 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.549969 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.550174 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.550260 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.550476 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.550561 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.550781 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.550866 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.551114 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.551200 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.551428 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.551525 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.551734 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.551820 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.552049 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.552134 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.552354 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.552442 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.552667 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.552752 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.552976 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.553068 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.553303 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.553391 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.553609 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.553707 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.553933 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.554028 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.554236 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.554322 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.554543 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.554636 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.554851 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.554949 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.555156 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.555242 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.555459 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.555544 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.555762 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.555857 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.556070 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.556155 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.556921 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.557027 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.557280 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.557414 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.557613 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.557700 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.557923 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.558008 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.558252 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.558341 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.558562 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.558647 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.558871 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.558957 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.559187 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.559273 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.559495 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.559589 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.559803 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.559906 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.560109 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.560195 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.560417 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.560503 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.560726 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.560826 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.561052 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.561139 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.561372 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.561459 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.561683 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.561782 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.561996 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.562081 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.562304 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.562395 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.562621 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.562706 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.562937 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.563024 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.563240 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.563325 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.563561 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.563648 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.563881 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.564025 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.564209 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.564296 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.564517 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.564602 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.564855 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.564949 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.565178 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.565294 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.565509 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.565597 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.565819 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.565905 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.566121 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.566214 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.566358 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 19:03:50.566452 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.566760 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:50.567005 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 19:03:50.719344 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: INFO dbcounter [None req-174af782-755c-4474-b5ec-677a4f2e84a0 None None] Registered counter for database nova_api Aug 31 19:03:50.719615 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: INFO dbcounter [None req-40f0270d-88d3-4357-86d1-db7818eae76b None None] Registered counter for database nova_api Aug 31 19:03:50.739812 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_db.sqlalchemy.engines [None req-40f0270d-88d3-4357-86d1-db7818eae76b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105611) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 19:03:50.741487 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG oslo_db.sqlalchemy.engines [None req-174af782-755c-4474-b5ec-677a4f2e84a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105612) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 19:03:50.746624 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG dbcounter [-] [105611] Writer thread running {{(pid=105611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 19:03:50.748167 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG dbcounter [-] [105612] Writer thread running {{(pid=105612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 19:03:50.802307 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.context [None req-40f0270d-88d3-4357-86d1-db7818eae76b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),658714ec-07f2-4e1f-a605-05702ce30e13(cell1) {{(pid=105611) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 19:03:50.804002 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.context [None req-174af782-755c-4474-b5ec-677a4f2e84a0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),658714ec-07f2-4e1f-a605-05702ce30e13(cell1) {{(pid=105612) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 19:03:50.806166 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-40f0270d-88d3-4357-86d1-db7818eae76b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:03:50.807235 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-40f0270d-88d3-4357-86d1-db7818eae76b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:03:50.808356 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG oslo_concurrency.lockutils [None req-174af782-755c-4474-b5ec-677a4f2e84a0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:03:50.808803 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-40f0270d-88d3-4357-86d1-db7818eae76b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:03:50.808914 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG oslo_concurrency.lockutils [None req-174af782-755c-4474-b5ec-677a4f2e84a0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:03:50.809556 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-40f0270d-88d3-4357-86d1-db7818eae76b None None] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:03:50.809999 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-40f0270d-88d3-4357-86d1-db7818eae76b None None] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:03:50.810403 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG oslo_concurrency.lockutils [None req-174af782-755c-4474-b5ec-677a4f2e84a0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:03:50.811211 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG oslo_concurrency.lockutils [None req-174af782-755c-4474-b5ec-677a4f2e84a0 None None] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:03:50.811647 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG oslo_concurrency.lockutils [None req-174af782-755c-4474-b5ec-677a4f2e84a0 None None] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:03:50.811991 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-40f0270d-88d3-4357-86d1-db7818eae76b None None] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:03:50.813718 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG oslo_concurrency.lockutils [None req-174af782-755c-4474-b5ec-677a4f2e84a0 None None] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:03:50.813977 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: INFO dbcounter [None req-40f0270d-88d3-4357-86d1-db7818eae76b None None] Registered counter for database nova_cell0 Aug 31 19:03:50.815660 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: INFO dbcounter [None req-174af782-755c-4474-b5ec-677a4f2e84a0 None None] Registered counter for database nova_cell0 Aug 31 19:03:50.819391 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: INFO dbcounter [None req-40f0270d-88d3-4357-86d1-db7818eae76b None None] Registered counter for database nova_cell1 Aug 31 19:03:50.819595 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: INFO dbcounter [None req-174af782-755c-4474-b5ec-677a4f2e84a0 None None] Registered counter for database nova_cell1 Aug 31 19:03:50.827212 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_db.sqlalchemy.engines [None req-40f0270d-88d3-4357-86d1-db7818eae76b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105611) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 19:03:50.828855 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_db.sqlalchemy.engines [None req-40f0270d-88d3-4357-86d1-db7818eae76b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105611) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 19:03:50.830489 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG oslo_db.sqlalchemy.engines [None req-174af782-755c-4474-b5ec-677a4f2e84a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105612) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 19:03:50.833519 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG oslo_db.sqlalchemy.engines [None req-174af782-755c-4474-b5ec-677a4f2e84a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105612) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 19:03:50.834956 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG dbcounter [-] [105611] Writer thread running {{(pid=105611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 19:03:50.837730 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG dbcounter [-] [105611] Writer thread running {{(pid=105611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 19:03:50.840510 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG dbcounter [-] [105612] Writer thread running {{(pid=105612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 19:03:50.842031 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG dbcounter [-] [105612] Writer thread running {{(pid=105612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 19:03:50.981895 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: INFO dbcounter [None req-40f0270d-88d3-4357-86d1-db7818eae76b None None] Registered counter for database nova_cell0 Aug 31 19:03:50.986524 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: INFO dbcounter [None req-174af782-755c-4474-b5ec-677a4f2e84a0 None None] Registered counter for database nova_cell0 Aug 31 19:03:50.988708 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_db.sqlalchemy.engines [None req-40f0270d-88d3-4357-86d1-db7818eae76b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105611) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 19:03:50.993098 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG dbcounter [-] [105611] Writer thread running {{(pid=105611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 19:03:50.995321 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG oslo_db.sqlalchemy.engines [None req-174af782-755c-4474-b5ec-677a4f2e84a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105612) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 19:03:51.000166 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG dbcounter [-] [105612] Writer thread running {{(pid=105612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 19:03:51.336516 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: WARNING keystonemiddleware.auth_token [None req-174af782-755c-4474-b5ec-677a4f2e84a0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 19:03:51.341063 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: WARNING keystonemiddleware.auth_token [None req-40f0270d-88d3-4357-86d1-db7818eae76b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 19:03:51.344382 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: WARNING keystonemiddleware.auth_token [None req-174af782-755c-4474-b5ec-677a4f2e84a0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 19:03:51.348617 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: WARNING keystonemiddleware.auth_token [None req-40f0270d-88d3-4357-86d1-db7818eae76b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 19:03:51.688114 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: WARNING keystonemiddleware.auth_token [None req-174af782-755c-4474-b5ec-677a4f2e84a0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 19:03:51.691818 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: WARNING keystonemiddleware.auth_token [None req-40f0270d-88d3-4357-86d1-db7818eae76b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 19:03:51.694022 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: WARNING keystonemiddleware.auth_token [None req-174af782-755c-4474-b5ec-677a4f2e84a0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 19:03:51.697776 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: WARNING keystonemiddleware.auth_token [None req-40f0270d-88d3-4357-86d1-db7818eae76b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 19:03:51.699410 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56408fddc9c0 pid: 105612 (default app) Aug 31 19:03:51.701515 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-174af782-755c-4474-b5ec-677a4f2e84a0 None None] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:03:51.702692 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-174af782-755c-4474-b5ec-677a4f2e84a0 None None] 10.222.0.65 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001767 Aug 31 19:03:51.703007 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56408fddc9c0 pid: 105611 (default app) Aug 31 19:03:51.703118 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 1/1] 10.222.0.65 () {50 vars in 788 bytes} [Wed Aug 31 19:03:51 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:05:09.562062 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-40f0270d-88d3-4357-86d1-db7818eae76b None None] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:05:09.563586 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-40f0270d-88d3-4357-86d1-db7818eae76b None None] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002212 Aug 31 19:05:09.564491 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 1/2] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 31 19:05:09 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:05:09.576428 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG dbcounter [-] [105612] Writing DB stats nova_api:SELECT=3 {{(pid=105612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:09.577591 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG dbcounter [-] [105612] Writing DB stats nova_cell1:SELECT=3 {{(pid=105612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:09.578611 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG dbcounter [-] [105612] Writing DB stats nova_cell0:SELECT=3 {{(pid=105612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:09.579377 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG dbcounter [-] [105612] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:10.466806 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-2f499604-5b24-4914-b6b6-6c4fb6a031fb admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:05:10.499771 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-2f499604-5b24-4914-b6b6-6c4fb6a031fb admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.929170 Aug 31 19:05:10.500657 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 2/3] 10.222.0.65 () {60 vars in 1292 bytes} [Wed Aug 31 19:05:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:05:12.915294 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-40f0270d-88d3-4357-86d1-db7818eae76b None None] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:05:12.915937 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-40f0270d-88d3-4357-86d1-db7818eae76b None None] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Aug 31 19:05:12.920958 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 2/4] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 31 19:05:12 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:05:13.358068 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-50d7b982-7a55-43d1-9006-8acec3f0424d admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "name": "cirros256", "id": "c1", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 256}} {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:05:13.416006 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-50d7b982-7a55-43d1-9006-8acec3f0424d admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.493467 Aug 31 19:05:13.416942 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 3/5] 10.222.0.65 () {64 vars in 1283 bytes} [Wed Aug 31 19:05:12 2022] POST /compute/v2.1/flavors => generated 407 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 19:05:13.642974 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-2efa3c28-5bb0-4fd1-8af0-5a4e319b942d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:05:13.661712 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG dbcounter [-] [105611] Writing DB stats nova_api:SELECT=3 {{(pid=105611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:13.662555 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG dbcounter [-] [105611] Writing DB stats nova_cell0:SELECT=3 {{(pid=105611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:13.663481 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG dbcounter [-] [105611] Writing DB stats nova_cell1:SELECT=3 {{(pid=105611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:13.664184 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG dbcounter [-] [105611] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:13.712445 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-2efa3c28-5bb0-4fd1-8af0-5a4e319b942d admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.286200 Aug 31 19:05:13.713041 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 3/6] 10.222.0.65 () {64 vars in 1336 bytes} [Wed Aug 31 19:05:13 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:05:16.057957 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-50d7b982-7a55-43d1-9006-8acec3f0424d admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:05:16.059776 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-50d7b982-7a55-43d1-9006-8acec3f0424d admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002300 Aug 31 19:05:16.060473 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 4/7] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 31 19:05:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:05:16.703760 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-2423faa6-62bd-4dc8-8201-350eb19705a7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds512M", "ram": 512, "vcpus": 1, "disk": 5}} {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:05:16.743988 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-2423faa6-62bd-4dc8-8201-350eb19705a7 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.676977 Aug 31 19:05:16.744930 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 4/8] 10.222.0.65 () {64 vars in 1283 bytes} [Wed Aug 31 19:05:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 19:05:16.757352 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-8710e96c-c3c1-4503-8d5c-3bd4850ec497 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:05:16.796737 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-8710e96c-c3c1-4503-8d5c-3bd4850ec497 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043187 Aug 31 19:05:16.807214 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 5/9] 10.222.0.65 () {64 vars in 1336 bytes} [Wed Aug 31 19:05:16 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:05:19.155261 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-2423faa6-62bd-4dc8-8201-350eb19705a7 admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:05:19.156192 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-2423faa6-62bd-4dc8-8201-350eb19705a7 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Aug 31 19:05:19.156608 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 5/10] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 31 19:05:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:05:19.568928 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-d9f11101-c892-48cc-b563-b6e83d3990b2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "vcpus": 1, "id": "d2", "rxtx_factor": 1.0, "swap": 0, "ram": 1024, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:05:19.587639 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-d9f11101-c892-48cc-b563-b6e83d3990b2 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.425104 Aug 31 19:05:19.588188 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 6/11] 10.222.0.65 () {64 vars in 1283 bytes} [Wed Aug 31 19:05:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 19:05:19.600206 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-16cecc79-aaae-48f2-bc4a-a0c9e452794b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:05:19.624109 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-16cecc79-aaae-48f2-bc4a-a0c9e452794b admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027531 Aug 31 19:05:19.624648 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 6/12] 10.222.0.65 () {64 vars in 1336 bytes} [Wed Aug 31 19:05:19 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:05:21.972721 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-d9f11101-c892-48cc-b563-b6e83d3990b2 admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:05:21.973814 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-d9f11101-c892-48cc-b563-b6e83d3990b2 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001591 Aug 31 19:05:21.974223 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 7/13] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 31 19:05:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:05:22.439937 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-a16d01d9-b7de-469d-bcab-762006188f4f admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 10, "id": "d3", "name": "ds2G", "vcpus": 2, "swap": 0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:05:22.459810 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-a16d01d9-b7de-469d-bcab-762006188f4f admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.478882 Aug 31 19:05:22.460451 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 7/14] 10.222.0.65 () {64 vars in 1283 bytes} [Wed Aug 31 19:05:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 19:05:22.472984 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-dda02c55-6458-4cab-89e8-56b3b62bec3c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:05:22.500039 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-dda02c55-6458-4cab-89e8-56b3b62bec3c admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031193 Aug 31 19:05:22.501806 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 8/15] 10.222.0.65 () {64 vars in 1336 bytes} [Wed Aug 31 19:05:22 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:05:24.845277 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-a16d01d9-b7de-469d-bcab-762006188f4f admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:05:24.847038 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-a16d01d9-b7de-469d-bcab-762006188f4f admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002184 Aug 31 19:05:24.848392 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 8/16] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 31 19:05:24 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:05:25.301965 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-3c33a61b-02f4-48c7-8186-85be02370b75 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "name": "ds4G", "vcpus": 4, "swap": 0, "os-flavor-access:is_public": true, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "rxtx_factor": 1.0}} {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:05:25.323351 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-3c33a61b-02f4-48c7-8186-85be02370b75 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.468513 Aug 31 19:05:25.325239 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 9/17] 10.222.0.65 () {64 vars in 1283 bytes} [Wed Aug 31 19:05:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 19:05:25.337017 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-598cfc8a-ecbd-4209-b95c-59111916a268 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:05:25.368561 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-598cfc8a-ecbd-4209-b95c-59111916a268 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035730 Aug 31 19:05:25.370090 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 9/18] 10.222.0.65 () {64 vars in 1336 bytes} [Wed Aug 31 19:05:25 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:05:27.760992 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-3c33a61b-02f4-48c7-8186-85be02370b75 admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:05:27.762066 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-3c33a61b-02f4-48c7-8186-85be02370b75 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 Aug 31 19:05:27.762491 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 10/19] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 31 19:05:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:05:28.173520 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-7d7bef4c-eaf9-4b2c-aa1e-abd9b8d0d86d admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:05:28.198883 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-7d7bef4c-eaf9-4b2c-aa1e-abd9b8d0d86d admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.428472 Aug 31 19:05:28.199426 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 10/20] 10.222.0.65 () {60 vars in 1292 bytes} [Wed Aug 31 19:05:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:05:30.542059 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-3c33a61b-02f4-48c7-8186-85be02370b75 admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:05:30.543288 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-3c33a61b-02f4-48c7-8186-85be02370b75 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001970 Aug 31 19:05:30.543834 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 11/21] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 31 19:05:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:05:30.963375 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-e32a27ad-2c25-406f-9448-22d0a2466751 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.tiny", "disk": 1, "swap": 0, "vcpus": 1, "id": "1", "rxtx_factor": 1.0, "ram": 512}} {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:05:30.984138 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-e32a27ad-2c25-406f-9448-22d0a2466751 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.432526 Aug 31 19:05:30.984883 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 11/22] 10.222.0.65 () {64 vars in 1283 bytes} [Wed Aug 31 19:05:30 2022] POST /compute/v2.1/flavors => generated 402 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 19:05:30.999953 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-06df7945-3524-45eb-89e8-7588ee379bac admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:05:31.024754 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-06df7945-3524-45eb-89e8-7588ee379bac admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028911 Aug 31 19:05:31.025383 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 12/23] 10.222.0.65 () {64 vars in 1333 bytes} [Wed Aug 31 19:05:30 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:05:33.345969 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-e32a27ad-2c25-406f-9448-22d0a2466751 admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:05:33.346910 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-e32a27ad-2c25-406f-9448-22d0a2466751 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Aug 31 19:05:33.347312 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 12/24] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 31 19:05:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:05:33.738997 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-cf35f2f8-014c-4ef5-84ee-59caf6c48bc6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 2048, "swap": 0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "id": "2", "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:05:33.758529 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-cf35f2f8-014c-4ef5-84ee-59caf6c48bc6 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.404000 Aug 31 19:05:33.759079 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 13/25] 10.222.0.65 () {64 vars in 1283 bytes} [Wed Aug 31 19:05:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 19:05:33.771133 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-31de68dc-f3af-47c4-ade1-31576a1d2b94 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:05:33.794975 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-31de68dc-f3af-47c4-ade1-31576a1d2b94 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027670 Aug 31 19:05:33.795539 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 13/26] 10.222.0.65 () {64 vars in 1333 bytes} [Wed Aug 31 19:05:33 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:05:36.157103 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-cf35f2f8-014c-4ef5-84ee-59caf6c48bc6 admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:05:36.158219 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-cf35f2f8-014c-4ef5-84ee-59caf6c48bc6 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Aug 31 19:05:36.158796 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 14/27] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 31 19:05:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:05:36.649497 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-74980277-ed4c-4d45-b53c-00e155aea00f admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "name": "m1.medium", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2, "id": "3", "disk": 40, "swap": 0}} {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:05:36.670236 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-74980277-ed4c-4d45-b53c-00e155aea00f admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.503406 Aug 31 19:05:36.670806 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 14/28] 10.222.0.65 () {64 vars in 1283 bytes} [Wed Aug 31 19:05:36 2022] POST /compute/v2.1/flavors => generated 406 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 19:05:36.682947 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-ed8de0fe-2f4e-4817-b43f-33688e555183 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:05:36.709845 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-ed8de0fe-2f4e-4817-b43f-33688e555183 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030485 Aug 31 19:05:36.713548 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 15/29] 10.222.0.65 () {64 vars in 1333 bytes} [Wed Aug 31 19:05:36 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:05:39.059898 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-74980277-ed4c-4d45-b53c-00e155aea00f admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:05:39.060953 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-74980277-ed4c-4d45-b53c-00e155aea00f admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Aug 31 19:05:39.061393 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 15/30] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 31 19:05:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:05:39.545966 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-8e7187ac-01fe-498d-84a5-e17de57f34d2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "4", "disk": 80, "ram": 8192, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:05:39.574308 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-8e7187ac-01fe-498d-84a5-e17de57f34d2 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.506407 Aug 31 19:05:39.575957 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 16/31] 10.222.0.65 () {64 vars in 1283 bytes} [Wed Aug 31 19:05:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 19:05:39.589171 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-8160417b-b266-44f4-a44b-0a6e72b4fc4e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:05:39.656437 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-8160417b-b266-44f4-a44b-0a6e72b4fc4e admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.070968 Aug 31 19:05:39.674263 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 16/32] 10.222.0.65 () {64 vars in 1333 bytes} [Wed Aug 31 19:05:39 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:05:42.053209 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-8e7187ac-01fe-498d-84a5-e17de57f34d2 admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:05:42.054230 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-8e7187ac-01fe-498d-84a5-e17de57f34d2 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001648 Aug 31 19:05:42.055031 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 17/33] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 31 19:05:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:05:42.512754 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-ca40868d-b760-42d7-be97-047740a4e69b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "os-flavor-access:is_public": true, "disk": 160, "id": "5", "ram": 16384, "vcpus": 8, "rxtx_factor": 1.0, "swap": 0}} {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:05:42.532312 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-ca40868d-b760-42d7-be97-047740a4e69b admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.471066 Aug 31 19:05:42.533128 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 17/34] 10.222.0.65 () {64 vars in 1283 bytes} [Wed Aug 31 19:05:42 2022] POST /compute/v2.1/flavors => generated 408 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 19:05:42.547200 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-b28764de-870e-4103-a400-9894519c3060 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:05:42.556500 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG dbcounter [-] [105612] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:42.576325 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-b28764de-870e-4103-a400-9894519c3060 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032423 Aug 31 19:05:42.577834 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 18/35] 10.222.0.65 () {64 vars in 1333 bytes} [Wed Aug 31 19:05:42 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:06:01.508687 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-ca40868d-b760-42d7-be97-047740a4e69b admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:06:01.509756 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-ca40868d-b760-42d7-be97-047740a4e69b admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Aug 31 19:06:01.510162 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 18/36] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 31 19:06:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:06:01.898370 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-040db2d6-75d2-41dc-96da-1ed914e4d5a5 admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:06:01.918247 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-040db2d6-75d2-41dc-96da-1ed914e4d5a5 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.402247 Aug 31 19:06:01.918814 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 19/37] 10.222.0.65 () {60 vars in 1292 bytes} [Wed Aug 31 19:06:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:06:02.974121 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-ca40868d-b760-42d7-be97-047740a4e69b admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:06:02.975127 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-ca40868d-b760-42d7-be97-047740a4e69b admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Aug 31 19:06:02.975532 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 19/38] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Aug 31 19:06:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:06:03.492395 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-102015d7-b44c-4337-b328-649d60001464 admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:06:03.498327 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.wsgi [None req-102015d7-b44c-4337-b328-649d60001464 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 31 19:06:03.501585 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-102015d7-b44c-4337-b328-649d60001464 admin admin] Request method failure captured: Aug 31 19:06:03.501585 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 31 19:06:03.501585 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: Accept: application/json Aug 31 19:06:03.501585 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: Accept-Encoding: gzip, deflate Aug 31 19:06:03.501585 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: Connection: keep-alive Aug 31 19:06:03.501585 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: Content-Length: 0 Aug 31 19:06:03.501585 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: Host: 10.222.0.65 Aug 31 19:06:03.501585 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: Openstack-Api-Version: compute 2.90 Aug 31 19:06:03.501585 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: Openstack-System-Scope: None Aug 31 19:06:03.501585 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: User-Agent: python-novaclient Aug 31 19:06:03.501585 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: X-Auth-Token: gAAAAABjD7Ea7NIZxvqefLWyqNjfcklU4BLUF76aUwH2VhCw8WAtYrLjEmXkPrDT1mp48PoGFhuE6wpaQBoK3dXoaxXCMCL7ROMoOURDnxHgpKuRLm0gA-OZwj1YlxgZXHMsVdy2LF8V0f8f2Y2bUJG5IR_7hErWyMzhJ4U04Q6EuUm8Bm-SC5Q Aug 31 19:06:03.501585 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: X-Domain-Id: None Aug 31 19:06:03.501585 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: X-Domain-Name: None Aug 31 19:06:03.501585 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: X-Identity-Status: Confirmed Aug 31 19:06:03.501585 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: X-Is-Admin-Project: True Aug 31 19:06:03.501585 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 19:06:03.501585 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: X-Project-Domain-Id: default Aug 31 19:06:03.501585 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: X-Project-Domain-Name: Default Aug 31 19:06:03.501585 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: X-Project-Id: 8d8519390e3f4536964a76bc41b6e43c Aug 31 19:06:03.501585 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: X-Project-Name: admin Aug 31 19:06:03.501585 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: X-Role: member,reader,admin Aug 31 19:06:03.501585 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: X-Roles: member,reader,admin Aug 31 19:06:03.503155 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/8d8519390e3f4536964a76bc41b6e43c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8d8519390e3f4536964a76bc41b6e43c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_8d8519390e3f4536964a76bc41b6e43c", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8d8519390e3f4536964a76bc41b6e43c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:06:03.503155 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: X-Tenant: admin Aug 31 19:06:03.503155 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: X-Tenant-Id: 8d8519390e3f4536964a76bc41b6e43c Aug 31 19:06:03.503155 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: X-Tenant-Name: admin Aug 31 19:06:03.503155 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: X-User: admin Aug 31 19:06:03.503155 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: X-User-Domain-Id: default Aug 31 19:06:03.503155 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: X-User-Domain-Name: Default Aug 31 19:06:03.503155 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: X-User-Id: 2d817dbb81e84447ac0c66c6621a6e8f Aug 31 19:06:03.503155 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: X-User-Name: admin Aug 31 19:06:03.503155 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: method: > Aug 31 19:06:03.503155 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: exception: Flavor 42 could not be found. Aug 31 19:06:03.503155 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: action_args: {'id': '42'} Aug 31 19:06:03.503155 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:06:03.503155 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:06:03.504297 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 19:06:03.504297 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 19:06:03.504297 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 19:06:03.504297 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 19:06:03.504297 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 19:06:03.504297 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 19:06:03.504297 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 19:06:03.504297 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 19:06:03.504297 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 19:06:03.504297 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:06:03.504297 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 19:06:03.504297 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 19:06:03.504297 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 31 19:06:03.504297 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Aug 31 19:06:03.504297 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:06:03.504297 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Aug 31 19:06:03.504297 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:06:03.504297 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:06:03.504297 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:06:03.505774 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:06:03.505774 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:06:03.505774 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:06:03.505774 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:06:03.505774 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 19:06:03.505774 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:06:03.505774 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 31 19:06:03.505774 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Aug 31 19:06:03.505774 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:06:03.505774 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Aug 31 19:06:03.505774 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:06:03.505774 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:06:03.505774 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:06:03.505774 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:06:03.505774 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:06:03.505774 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 31 19:06:03.505774 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Aug 31 19:06:03.505774 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-102015d7-b44c-4337-b328-649d60001464 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:06:03.507099 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-102015d7-b44c-4337-b328-649d60001464 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.389776 Aug 31 19:06:03.507099 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 20/39] 10.222.0.65 () {60 vars in 1190 bytes} [Wed Aug 31 19:06:03 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 19:06:03.512659 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-d04906d3-0a55-4f1b-9c1f-2d941caf06bf admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:06:03.516701 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG dbcounter [-] [105611] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:03.536290 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-d04906d3-0a55-4f1b-9c1f-2d941caf06bf admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027107 Aug 31 19:06:03.536841 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 20/40] 10.222.0.65 () {60 vars in 1210 bytes} [Wed Aug 31 19:06:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:06:03.547109 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-f26c77a1-7689-486f-92bf-3cdbef7e0925 admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:06:03.569093 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-f26c77a1-7689-486f-92bf-3cdbef7e0925 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025513 Aug 31 19:06:03.569654 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 21/41] 10.222.0.65 () {60 vars in 1210 bytes} [Wed Aug 31 19:06:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:06:03.579717 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-ffe4df39-ac77-4423-9dd7-aeb37f2c61a0 admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:06:03.586415 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.wsgi [None req-ffe4df39-ac77-4423-9dd7-aeb37f2c61a0 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 31 19:06:03.589690 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-ffe4df39-ac77-4423-9dd7-aeb37f2c61a0 admin admin] Request method failure captured: Aug 31 19:06:03.589690 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 31 19:06:03.589690 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: Accept: application/json Aug 31 19:06:03.589690 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: Accept-Encoding: gzip, deflate Aug 31 19:06:03.589690 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: Connection: keep-alive Aug 31 19:06:03.589690 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: Content-Length: 0 Aug 31 19:06:03.589690 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: Host: 10.222.0.65 Aug 31 19:06:03.589690 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: Openstack-Api-Version: compute 2.90 Aug 31 19:06:03.589690 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: Openstack-System-Scope: None Aug 31 19:06:03.589690 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: User-Agent: python-novaclient Aug 31 19:06:03.589690 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: X-Auth-Token: gAAAAABjD7Ea7NIZxvqefLWyqNjfcklU4BLUF76aUwH2VhCw8WAtYrLjEmXkPrDT1mp48PoGFhuE6wpaQBoK3dXoaxXCMCL7ROMoOURDnxHgpKuRLm0gA-OZwj1YlxgZXHMsVdy2LF8V0f8f2Y2bUJG5IR_7hErWyMzhJ4U04Q6EuUm8Bm-SC5Q Aug 31 19:06:03.589690 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: X-Domain-Id: None Aug 31 19:06:03.589690 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: X-Domain-Name: None Aug 31 19:06:03.589690 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: X-Identity-Status: Confirmed Aug 31 19:06:03.589690 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: X-Is-Admin-Project: True Aug 31 19:06:03.589690 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 19:06:03.589690 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: X-Project-Domain-Id: default Aug 31 19:06:03.589690 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: X-Project-Domain-Name: Default Aug 31 19:06:03.589690 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: X-Project-Id: 8d8519390e3f4536964a76bc41b6e43c Aug 31 19:06:03.589690 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: X-Project-Name: admin Aug 31 19:06:03.589690 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: X-Role: member,reader,admin Aug 31 19:06:03.589690 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: X-Roles: member,reader,admin Aug 31 19:06:03.591264 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/8d8519390e3f4536964a76bc41b6e43c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8d8519390e3f4536964a76bc41b6e43c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_8d8519390e3f4536964a76bc41b6e43c", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8d8519390e3f4536964a76bc41b6e43c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:06:03.591264 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: X-Tenant: admin Aug 31 19:06:03.591264 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: X-Tenant-Id: 8d8519390e3f4536964a76bc41b6e43c Aug 31 19:06:03.591264 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: X-Tenant-Name: admin Aug 31 19:06:03.591264 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: X-User: admin Aug 31 19:06:03.591264 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: X-User-Domain-Id: default Aug 31 19:06:03.591264 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: X-User-Domain-Name: Default Aug 31 19:06:03.591264 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: X-User-Id: 2d817dbb81e84447ac0c66c6621a6e8f Aug 31 19:06:03.591264 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: X-User-Name: admin Aug 31 19:06:03.591264 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: method: > Aug 31 19:06:03.591264 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: exception: Flavor 42 could not be found. Aug 31 19:06:03.591264 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: action_args: {'id': '42'} Aug 31 19:06:03.591264 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:06:03.591264 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:06:03.592194 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 19:06:03.592194 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 19:06:03.592194 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 19:06:03.592194 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 19:06:03.592194 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 19:06:03.592194 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 19:06:03.592194 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 19:06:03.592194 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 19:06:03.592194 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 19:06:03.592194 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:06:03.592194 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 19:06:03.592194 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 19:06:03.592194 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 31 19:06:03.592194 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Aug 31 19:06:03.592194 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:06:03.592194 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Aug 31 19:06:03.592194 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:06:03.592194 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:06:03.592194 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:06:03.593549 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:06:03.593549 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:06:03.593549 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:06:03.593549 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:06:03.593549 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 19:06:03.593549 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:06:03.593549 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 31 19:06:03.593549 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Aug 31 19:06:03.593549 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:06:03.593549 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Aug 31 19:06:03.593549 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:06:03.593549 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:06:03.593549 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:06:03.593549 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:06:03.593549 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:06:03.593549 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 31 19:06:03.593549 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Aug 31 19:06:03.593549 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-ffe4df39-ac77-4423-9dd7-aeb37f2c61a0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:06:03.594797 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-ffe4df39-ac77-4423-9dd7-aeb37f2c61a0 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015455 Aug 31 19:06:03.594797 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 21/42] 10.222.0.65 () {60 vars in 1190 bytes} [Wed Aug 31 19:06:03 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 31 19:06:04.554987 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-f26c77a1-7689-486f-92bf-3cdbef7e0925 admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:06:04.555995 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-f26c77a1-7689-486f-92bf-3cdbef7e0925 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Aug 31 19:06:04.556394 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 22/43] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Aug 31 19:06:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:06:05.078079 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-4ec33bb7-03e4-4521-ba7c-755a52c30b3f admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:06:05.083381 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.wsgi [None req-4ec33bb7-03e4-4521-ba7c-755a52c30b3f admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 31 19:06:05.084881 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-4ec33bb7-03e4-4521-ba7c-755a52c30b3f admin admin] Request method failure captured: Aug 31 19:06:05.084881 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 31 19:06:05.084881 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: Accept: application/json Aug 31 19:06:05.084881 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: Accept-Encoding: gzip, deflate Aug 31 19:06:05.084881 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: Connection: keep-alive Aug 31 19:06:05.084881 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: Content-Length: 0 Aug 31 19:06:05.084881 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: Host: 10.222.0.65 Aug 31 19:06:05.084881 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: Openstack-Api-Version: compute 2.90 Aug 31 19:06:05.084881 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: Openstack-System-Scope: None Aug 31 19:06:05.084881 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: User-Agent: python-novaclient Aug 31 19:06:05.084881 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: X-Auth-Token: gAAAAABjD7EcoBCpsv-EIj5VCDpxE-nVI9WJEFkhQRggaNIwV4AG9bhJaJD496DgklZXeSCkdHfrU4nFBwz3DEr-22zLOg-cIciGzUYCF0-3TKKp3iRLA1m2XRIC5OsBwBIFZa3co1x1Q8RNPGFzCh94NCePwqdNLU6aopSbj92j6HJDcEIH8WM Aug 31 19:06:05.084881 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: X-Domain-Id: None Aug 31 19:06:05.084881 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: X-Domain-Name: None Aug 31 19:06:05.084881 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: X-Identity-Status: Confirmed Aug 31 19:06:05.084881 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: X-Is-Admin-Project: True Aug 31 19:06:05.084881 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 19:06:05.084881 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: X-Project-Domain-Id: default Aug 31 19:06:05.084881 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: X-Project-Domain-Name: Default Aug 31 19:06:05.084881 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: X-Project-Id: 8d8519390e3f4536964a76bc41b6e43c Aug 31 19:06:05.084881 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: X-Project-Name: admin Aug 31 19:06:05.084881 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: X-Role: member,reader,admin Aug 31 19:06:05.084881 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: X-Roles: member,reader,admin Aug 31 19:06:05.086579 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/8d8519390e3f4536964a76bc41b6e43c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8d8519390e3f4536964a76bc41b6e43c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_8d8519390e3f4536964a76bc41b6e43c", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8d8519390e3f4536964a76bc41b6e43c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:06:05.086579 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: X-Tenant: admin Aug 31 19:06:05.086579 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: X-Tenant-Id: 8d8519390e3f4536964a76bc41b6e43c Aug 31 19:06:05.086579 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: X-Tenant-Name: admin Aug 31 19:06:05.086579 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: X-User: admin Aug 31 19:06:05.086579 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: X-User-Domain-Id: default Aug 31 19:06:05.086579 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: X-User-Domain-Name: Default Aug 31 19:06:05.086579 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: X-User-Id: 2d817dbb81e84447ac0c66c6621a6e8f Aug 31 19:06:05.086579 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: X-User-Name: admin Aug 31 19:06:05.086579 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: method: > Aug 31 19:06:05.086579 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: exception: Flavor 84 could not be found. Aug 31 19:06:05.086579 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: action_args: {'id': '84'} Aug 31 19:06:05.086579 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:06:05.086579 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:06:05.087438 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 19:06:05.087438 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 19:06:05.087438 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 19:06:05.087438 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 19:06:05.087438 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 19:06:05.087438 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 19:06:05.087438 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 19:06:05.087438 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 19:06:05.087438 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 19:06:05.087438 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:06:05.087438 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 19:06:05.087438 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 19:06:05.087438 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 31 19:06:05.087438 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Aug 31 19:06:05.087438 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:06:05.087438 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Aug 31 19:06:05.087438 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:06:05.087438 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:06:05.087438 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:06:05.088564 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:06:05.088564 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:06:05.088564 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:06:05.088564 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:06:05.088564 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 19:06:05.088564 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:06:05.088564 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 31 19:06:05.088564 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Aug 31 19:06:05.088564 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:06:05.088564 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Aug 31 19:06:05.088564 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:06:05.088564 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:06:05.088564 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:06:05.088564 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:06:05.088564 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:06:05.088564 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 31 19:06:05.088564 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Aug 31 19:06:05.088564 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-4ec33bb7-03e4-4521-ba7c-755a52c30b3f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:06:05.089870 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-4ec33bb7-03e4-4521-ba7c-755a52c30b3f admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.391679 Aug 31 19:06:05.089870 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 22/44] 10.222.0.65 () {60 vars in 1190 bytes} [Wed Aug 31 19:06:04 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 31 19:06:05.095946 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-f2946bbc-52fa-4c11-bf8c-dc39cfd00c03 admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:06:05.110965 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-f2946bbc-52fa-4c11-bf8c-dc39cfd00c03 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018640 Aug 31 19:06:05.111514 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 23/45] 10.222.0.65 () {60 vars in 1210 bytes} [Wed Aug 31 19:06:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:06:05.121537 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-3cf31ef5-4fb3-4166-b300-e4cb8490aefd admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:06:05.138481 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-3cf31ef5-4fb3-4166-b300-e4cb8490aefd admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020724 Aug 31 19:06:05.139011 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 23/46] 10.222.0.65 () {60 vars in 1210 bytes} [Wed Aug 31 19:06:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:06:05.148177 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-c883d904-5dcc-4f79-a8d5-a5ea787cb80d admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:06:05.153600 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.wsgi [None req-c883d904-5dcc-4f79-a8d5-a5ea787cb80d admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 31 19:06:05.155082 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-c883d904-5dcc-4f79-a8d5-a5ea787cb80d admin admin] Request method failure captured: Aug 31 19:06:05.155082 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 31 19:06:05.155082 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: Accept: application/json Aug 31 19:06:05.155082 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: Accept-Encoding: gzip, deflate Aug 31 19:06:05.155082 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: Connection: keep-alive Aug 31 19:06:05.155082 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: Content-Length: 0 Aug 31 19:06:05.155082 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: Host: 10.222.0.65 Aug 31 19:06:05.155082 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: Openstack-Api-Version: compute 2.90 Aug 31 19:06:05.155082 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: Openstack-System-Scope: None Aug 31 19:06:05.155082 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: User-Agent: python-novaclient Aug 31 19:06:05.155082 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: X-Auth-Token: gAAAAABjD7EcoBCpsv-EIj5VCDpxE-nVI9WJEFkhQRggaNIwV4AG9bhJaJD496DgklZXeSCkdHfrU4nFBwz3DEr-22zLOg-cIciGzUYCF0-3TKKp3iRLA1m2XRIC5OsBwBIFZa3co1x1Q8RNPGFzCh94NCePwqdNLU6aopSbj92j6HJDcEIH8WM Aug 31 19:06:05.155082 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: X-Domain-Id: None Aug 31 19:06:05.155082 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: X-Domain-Name: None Aug 31 19:06:05.155082 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: X-Identity-Status: Confirmed Aug 31 19:06:05.155082 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: X-Is-Admin-Project: True Aug 31 19:06:05.155082 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 19:06:05.155082 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: X-Project-Domain-Id: default Aug 31 19:06:05.155082 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: X-Project-Domain-Name: Default Aug 31 19:06:05.155082 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: X-Project-Id: 8d8519390e3f4536964a76bc41b6e43c Aug 31 19:06:05.155082 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: X-Project-Name: admin Aug 31 19:06:05.155082 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: X-Role: member,reader,admin Aug 31 19:06:05.155082 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: X-Roles: member,reader,admin Aug 31 19:06:05.156583 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/8d8519390e3f4536964a76bc41b6e43c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8d8519390e3f4536964a76bc41b6e43c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_8d8519390e3f4536964a76bc41b6e43c", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8d8519390e3f4536964a76bc41b6e43c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:06:05.156583 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: X-Tenant: admin Aug 31 19:06:05.156583 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: X-Tenant-Id: 8d8519390e3f4536964a76bc41b6e43c Aug 31 19:06:05.156583 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: X-Tenant-Name: admin Aug 31 19:06:05.156583 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: X-User: admin Aug 31 19:06:05.156583 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: X-User-Domain-Id: default Aug 31 19:06:05.156583 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: X-User-Domain-Name: Default Aug 31 19:06:05.156583 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: X-User-Id: 2d817dbb81e84447ac0c66c6621a6e8f Aug 31 19:06:05.156583 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: X-User-Name: admin Aug 31 19:06:05.156583 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: method: > Aug 31 19:06:05.156583 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: exception: Flavor 84 could not be found. Aug 31 19:06:05.156583 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: action_args: {'id': '84'} Aug 31 19:06:05.156583 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:06:05.156583 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:06:05.157428 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 19:06:05.157428 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 19:06:05.157428 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 19:06:05.157428 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 19:06:05.157428 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 19:06:05.157428 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 19:06:05.157428 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 19:06:05.157428 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 19:06:05.157428 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 19:06:05.157428 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:06:05.157428 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 19:06:05.157428 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 19:06:05.157428 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 31 19:06:05.157428 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Aug 31 19:06:05.157428 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:06:05.157428 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Aug 31 19:06:05.157428 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:06:05.157428 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:06:05.157428 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:06:05.158526 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:06:05.158526 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:06:05.158526 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:06:05.158526 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:06:05.158526 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 19:06:05.158526 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:06:05.158526 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 31 19:06:05.158526 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Aug 31 19:06:05.158526 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:06:05.158526 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Aug 31 19:06:05.158526 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:06:05.158526 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:06:05.158526 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:06:05.158526 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:06:05.158526 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:06:05.158526 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 31 19:06:05.158526 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Aug 31 19:06:05.158526 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-c883d904-5dcc-4f79-a8d5-a5ea787cb80d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:06:05.159560 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-c883d904-5dcc-4f79-a8d5-a5ea787cb80d admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011740 Aug 31 19:06:05.159560 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 24/47] 10.222.0.65 () {60 vars in 1190 bytes} [Wed Aug 31 19:06:05 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 19:06:06.117120 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-3cf31ef5-4fb3-4166-b300-e4cb8490aefd admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:06:06.118137 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-3cf31ef5-4fb3-4166-b300-e4cb8490aefd admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Aug 31 19:06:06.118523 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 24/48] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Aug 31 19:06:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:06:06.640217 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-1c78cb22-956b-4c6b-9e61-1eabc1579a32 admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:06:06.645980 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.wsgi [None req-1c78cb22-956b-4c6b-9e61-1eabc1579a32 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 31 19:06:06.647474 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-1c78cb22-956b-4c6b-9e61-1eabc1579a32 admin admin] Request method failure captured: Aug 31 19:06:06.647474 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 31 19:06:06.647474 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: Accept: application/json Aug 31 19:06:06.647474 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: Accept-Encoding: gzip, deflate Aug 31 19:06:06.647474 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: Connection: keep-alive Aug 31 19:06:06.647474 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: Content-Length: 0 Aug 31 19:06:06.647474 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: Host: 10.222.0.65 Aug 31 19:06:06.647474 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: Openstack-Api-Version: compute 2.90 Aug 31 19:06:06.647474 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: Openstack-System-Scope: None Aug 31 19:06:06.647474 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: User-Agent: python-novaclient Aug 31 19:06:06.647474 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: X-Auth-Token: gAAAAABjD7Ee5Ul9jsSKIScqAaeug93bbfIBfURuDuoi348r3MWpNBRoXifXMOxDWgmwt9JonWR-7yiwUk0BHI0cYuKXMEIqvSenqrxEjzZMNqGuJRsARKjk_uoq-AYt3FcboFWKxyfVhqF7yguY6GwzYqMbfutLF8luQbWxkfjB_j3EV6sT9A0 Aug 31 19:06:06.647474 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: X-Domain-Id: None Aug 31 19:06:06.647474 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: X-Domain-Name: None Aug 31 19:06:06.647474 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: X-Identity-Status: Confirmed Aug 31 19:06:06.647474 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: X-Is-Admin-Project: True Aug 31 19:06:06.647474 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 19:06:06.647474 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: X-Project-Domain-Id: default Aug 31 19:06:06.647474 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: X-Project-Domain-Name: Default Aug 31 19:06:06.647474 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: X-Project-Id: 8d8519390e3f4536964a76bc41b6e43c Aug 31 19:06:06.647474 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: X-Project-Name: admin Aug 31 19:06:06.647474 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: X-Role: member,reader,admin Aug 31 19:06:06.647474 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: X-Roles: member,reader,admin Aug 31 19:06:06.649246 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/8d8519390e3f4536964a76bc41b6e43c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8d8519390e3f4536964a76bc41b6e43c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_8d8519390e3f4536964a76bc41b6e43c", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8d8519390e3f4536964a76bc41b6e43c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:06:06.649246 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: X-Tenant: admin Aug 31 19:06:06.649246 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: X-Tenant-Id: 8d8519390e3f4536964a76bc41b6e43c Aug 31 19:06:06.649246 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: X-Tenant-Name: admin Aug 31 19:06:06.649246 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: X-User: admin Aug 31 19:06:06.649246 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: X-User-Domain-Id: default Aug 31 19:06:06.649246 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: X-User-Domain-Name: Default Aug 31 19:06:06.649246 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: X-User-Id: 2d817dbb81e84447ac0c66c6621a6e8f Aug 31 19:06:06.649246 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: X-User-Name: admin Aug 31 19:06:06.649246 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: method: > Aug 31 19:06:06.649246 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: exception: Flavor 451 could not be found. Aug 31 19:06:06.649246 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: action_args: {'id': '451'} Aug 31 19:06:06.649246 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:06:06.649246 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:06:06.650465 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 19:06:06.650465 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 19:06:06.650465 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 19:06:06.650465 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 19:06:06.650465 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 19:06:06.650465 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 19:06:06.650465 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 19:06:06.650465 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 19:06:06.650465 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 19:06:06.650465 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:06:06.650465 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 19:06:06.650465 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 19:06:06.650465 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 31 19:06:06.650465 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Aug 31 19:06:06.650465 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:06:06.650465 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Aug 31 19:06:06.650465 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:06:06.650465 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:06:06.650465 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:06:06.651773 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:06:06.651773 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:06:06.651773 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:06:06.651773 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:06:06.651773 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 19:06:06.651773 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:06:06.651773 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 31 19:06:06.651773 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Aug 31 19:06:06.651773 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:06:06.651773 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Aug 31 19:06:06.651773 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:06:06.651773 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:06:06.651773 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:06:06.651773 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:06:06.651773 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:06:06.651773 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 31 19:06:06.651773 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Aug 31 19:06:06.651773 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-1c78cb22-956b-4c6b-9e61-1eabc1579a32 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:06:06.653238 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-1c78cb22-956b-4c6b-9e61-1eabc1579a32 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.389786 Aug 31 19:06:06.653238 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 25/49] 10.222.0.65 () {60 vars in 1193 bytes} [Wed Aug 31 19:06:06 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 19:06:06.658580 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-308dec76-5c54-4221-a418-cdc9a9237369 admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:06:06.673340 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-308dec76-5c54-4221-a418-cdc9a9237369 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018300 Aug 31 19:06:06.673866 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 25/50] 10.222.0.65 () {60 vars in 1210 bytes} [Wed Aug 31 19:06:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:06:06.683694 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-9c099b0c-b0c9-4f14-ba8a-fa221cdfabdc admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:06:06.699071 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-9c099b0c-b0c9-4f14-ba8a-fa221cdfabdc admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018929 Aug 31 19:06:06.699590 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 26/51] 10.222.0.65 () {60 vars in 1210 bytes} [Wed Aug 31 19:06:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:06:06.708488 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-8f17d319-9412-47a8-bf60-e28f79f77c72 admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:06:06.713751 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.wsgi [None req-8f17d319-9412-47a8-bf60-e28f79f77c72 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 31 19:06:06.715232 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-8f17d319-9412-47a8-bf60-e28f79f77c72 admin admin] Request method failure captured: Aug 31 19:06:06.715232 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 31 19:06:06.715232 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: Accept: application/json Aug 31 19:06:06.715232 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: Accept-Encoding: gzip, deflate Aug 31 19:06:06.715232 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: Connection: keep-alive Aug 31 19:06:06.715232 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: Content-Length: 0 Aug 31 19:06:06.715232 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: Host: 10.222.0.65 Aug 31 19:06:06.715232 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: Openstack-Api-Version: compute 2.90 Aug 31 19:06:06.715232 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: Openstack-System-Scope: None Aug 31 19:06:06.715232 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: User-Agent: python-novaclient Aug 31 19:06:06.715232 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: X-Auth-Token: gAAAAABjD7Ee5Ul9jsSKIScqAaeug93bbfIBfURuDuoi348r3MWpNBRoXifXMOxDWgmwt9JonWR-7yiwUk0BHI0cYuKXMEIqvSenqrxEjzZMNqGuJRsARKjk_uoq-AYt3FcboFWKxyfVhqF7yguY6GwzYqMbfutLF8luQbWxkfjB_j3EV6sT9A0 Aug 31 19:06:06.715232 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: X-Domain-Id: None Aug 31 19:06:06.715232 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: X-Domain-Name: None Aug 31 19:06:06.715232 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: X-Identity-Status: Confirmed Aug 31 19:06:06.715232 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: X-Is-Admin-Project: True Aug 31 19:06:06.715232 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 19:06:06.715232 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: X-Project-Domain-Id: default Aug 31 19:06:06.715232 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: X-Project-Domain-Name: Default Aug 31 19:06:06.715232 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: X-Project-Id: 8d8519390e3f4536964a76bc41b6e43c Aug 31 19:06:06.715232 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: X-Project-Name: admin Aug 31 19:06:06.715232 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: X-Role: member,reader,admin Aug 31 19:06:06.715232 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: X-Roles: member,reader,admin Aug 31 19:06:06.716824 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/8d8519390e3f4536964a76bc41b6e43c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8d8519390e3f4536964a76bc41b6e43c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_8d8519390e3f4536964a76bc41b6e43c", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8d8519390e3f4536964a76bc41b6e43c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:06:06.716824 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: X-Tenant: admin Aug 31 19:06:06.716824 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: X-Tenant-Id: 8d8519390e3f4536964a76bc41b6e43c Aug 31 19:06:06.716824 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: X-Tenant-Name: admin Aug 31 19:06:06.716824 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: X-User: admin Aug 31 19:06:06.716824 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: X-User-Domain-Id: default Aug 31 19:06:06.716824 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: X-User-Domain-Name: Default Aug 31 19:06:06.716824 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: X-User-Id: 2d817dbb81e84447ac0c66c6621a6e8f Aug 31 19:06:06.716824 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: X-User-Name: admin Aug 31 19:06:06.716824 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: method: > Aug 31 19:06:06.716824 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: exception: Flavor 451 could not be found. Aug 31 19:06:06.716824 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: action_args: {'id': '451'} Aug 31 19:06:06.716824 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:06:06.716824 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:06:06.717845 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 19:06:06.717845 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 19:06:06.717845 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 19:06:06.717845 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 19:06:06.717845 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 19:06:06.717845 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 19:06:06.717845 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 19:06:06.717845 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 19:06:06.717845 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 19:06:06.717845 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:06:06.717845 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 19:06:06.717845 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 19:06:06.717845 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 31 19:06:06.717845 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Aug 31 19:06:06.717845 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:06:06.717845 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Aug 31 19:06:06.717845 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:06:06.717845 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:06:06.717845 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:06:06.719149 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:06:06.719149 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:06:06.719149 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:06:06.719149 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:06:06.719149 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 19:06:06.719149 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:06:06.719149 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 31 19:06:06.719149 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Aug 31 19:06:06.719149 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:06:06.719149 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Aug 31 19:06:06.719149 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:06:06.719149 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:06:06.719149 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:06:06.719149 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:06:06.719149 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:06:06.719149 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 31 19:06:06.719149 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Aug 31 19:06:06.719149 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-8f17d319-9412-47a8-bf60-e28f79f77c72 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:06:06.720420 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-8f17d319-9412-47a8-bf60-e28f79f77c72 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011574 Aug 31 19:06:06.720420 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 26/52] 10.222.0.65 () {60 vars in 1193 bytes} [Wed Aug 31 19:06:06 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 19:06:07.681992 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-9c099b0c-b0c9-4f14-ba8a-fa221cdfabdc admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:06:07.683025 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-9c099b0c-b0c9-4f14-ba8a-fa221cdfabdc admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Aug 31 19:06:07.683409 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 27/53] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Aug 31 19:06:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:06:08.203050 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-8beb6544-ded2-4829-9fbd-4385c1aa3570 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:06:08.223355 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-8beb6544-ded2-4829-9fbd-4385c1aa3570 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.400017 Aug 31 19:06:08.223902 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 27/54] 10.222.0.65 () {64 vars in 1235 bytes} [Wed Aug 31 19:06:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 19:06:09.192916 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-9c099b0c-b0c9-4f14-ba8a-fa221cdfabdc admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:06:09.193971 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-9c099b0c-b0c9-4f14-ba8a-fa221cdfabdc admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001570 Aug 31 19:06:09.194868 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 28/55] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Aug 31 19:06:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:06:09.715418 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-a0ee9977-b28b-4f91-b601-de916f854da6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:06:09.734244 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-a0ee9977-b28b-4f91-b601-de916f854da6 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.401741 Aug 31 19:06:09.734786 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 28/56] 10.222.0.65 () {64 vars in 1235 bytes} [Wed Aug 31 19:06:09 2022] POST /compute/v2.1/flavors => generated 405 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 19:06:10.729397 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-9c099b0c-b0c9-4f14-ba8a-fa221cdfabdc admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:06:10.730402 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-9c099b0c-b0c9-4f14-ba8a-fa221cdfabdc admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 31 19:06:10.730795 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 29/57] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Aug 31 19:06:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:06:11.257833 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-3b6eb7cb-bc01-4ded-b569-019cd2cbdf4d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:06:11.276949 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-3b6eb7cb-bc01-4ded-b569-019cd2cbdf4d admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.408673 Aug 31 19:06:11.277539 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 29/58] 10.222.0.65 () {64 vars in 1235 bytes} [Wed Aug 31 19:06:10 2022] POST /compute/v2.1/flavors => generated 407 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 19:06:12.239974 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-9c099b0c-b0c9-4f14-ba8a-fa221cdfabdc admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:06:12.240965 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-9c099b0c-b0c9-4f14-ba8a-fa221cdfabdc admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Aug 31 19:06:12.241390 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 30/59] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Aug 31 19:06:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:06:12.761652 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-a31bc4d1-7d8b-4901-be1f-906166aa4033 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:06:12.779668 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-a31bc4d1-7d8b-4901-be1f-906166aa4033 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.402838 Aug 31 19:06:12.780217 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 30/60] 10.222.0.65 () {64 vars in 1235 bytes} [Wed Aug 31 19:06:12 2022] POST /compute/v2.1/flavors => generated 409 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 19:06:13.865928 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-9c099b0c-b0c9-4f14-ba8a-fa221cdfabdc admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:06:13.867537 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-9c099b0c-b0c9-4f14-ba8a-fa221cdfabdc admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002058 Aug 31 19:06:13.867941 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 31/61] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Aug 31 19:06:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:06:14.408217 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-baae8b80-02ff-4628-ab2d-672c99843922 admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:06:14.429906 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-baae8b80-02ff-4628-ab2d-672c99843922 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.410128 Aug 31 19:06:14.430384 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 31/62] 10.222.0.65 () {60 vars in 1202 bytes} [Wed Aug 31 19:06:14 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:07:07.516560 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-9c099b0c-b0c9-4f14-ba8a-fa221cdfabdc admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:07:07.517628 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-9c099b0c-b0c9-4f14-ba8a-fa221cdfabdc admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Aug 31 19:07:07.518038 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 32/63] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 31 19:07:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:07:07.529078 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG dbcounter [-] [105611] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:07.907349 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-d294471b-596f-4f97-a9d1-68f9dcf63874 admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:07:07.928040 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-d294471b-596f-4f97-a9d1-68f9dcf63874 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.403434 Aug 31 19:07:07.928580 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 32/64] 10.222.0.65 () {60 vars in 1292 bytes} [Wed Aug 31 19:07:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:07:07.949946 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG dbcounter [-] [105612] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=105612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:07.953824 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-8ec3409d-1ca6-4e95-bbe2-3b15f2c403d2 admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:07:07.961893 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-8ec3409d-1ca6-4e95-bbe2-3b15f2c403d2 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013387 Aug 31 19:07:07.962408 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 33/65] 10.222.0.65 () {60 vars in 1283 bytes} [Wed Aug 31 19:07:07 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:07:07.973798 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-1e7ac1e8-6523-49da-b404-5d6fc047f9d8 admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:07:07.981306 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-1e7ac1e8-6523-49da-b404-5d6fc047f9d8 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011037 Aug 31 19:07:07.981825 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 33/66] 10.222.0.65 () {60 vars in 1286 bytes} [Wed Aug 31 19:07:07 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:07:07.993826 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-c69104d9-312f-4cbd-be90-db9511150ef6 admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:07:08.001920 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-c69104d9-312f-4cbd-be90-db9511150ef6 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012639 Aug 31 19:07:08.002433 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 34/67] 10.222.0.65 () {60 vars in 1286 bytes} [Wed Aug 31 19:07:07 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:07:08.014313 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-3ee8d413-7487-45ee-ae6b-f3024df2ce1c admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:07:08.021889 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-3ee8d413-7487-45ee-ae6b-f3024df2ce1c admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011061 Aug 31 19:07:08.022390 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 34/68] 10.222.0.65 () {60 vars in 1283 bytes} [Wed Aug 31 19:07:08 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:10:08.228989 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-c69104d9-312f-4cbd-be90-db9511150ef6 admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:10:08.230037 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-c69104d9-312f-4cbd-be90-db9511150ef6 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Aug 31 19:10:08.230469 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 35/69] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Aug 31 19:10:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:10:08.370742 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG dbcounter [-] [105611] Writing DB stats nova_api:SELECT=6 {{(pid=105611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:08.531244 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-7908c105-7fc9-4529-8d9a-4fa59600cc3f admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:10:08.534724 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-7908c105-7fc9-4529-8d9a-4fa59600cc3f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:10:08.535788 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-7908c105-7fc9-4529-8d9a-4fa59600cc3f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:10:08.536219 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-7908c105-7fc9-4529-8d9a-4fa59600cc3f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:10:08.536957 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-7908c105-7fc9-4529-8d9a-4fa59600cc3f admin admin] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:10:08.537440 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-7908c105-7fc9-4529-8d9a-4fa59600cc3f admin admin] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:10:08.537846 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-7908c105-7fc9-4529-8d9a-4fa59600cc3f admin admin] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:10:08.570823 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-7908c105-7fc9-4529-8d9a-4fa59600cc3f admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.201582 Aug 31 19:10:08.571377 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 35/70] 10.222.0.65 () {60 vars in 1193 bytes} [Wed Aug 31 19:10:08 2022] GET /compute/v2.1/os-services => generated 794 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 19:10:09.389139 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-c69104d9-312f-4cbd-be90-db9511150ef6 admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:10:09.390206 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-c69104d9-312f-4cbd-be90-db9511150ef6 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Aug 31 19:10:09.390605 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 36/71] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Aug 31 19:10:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:10:09.582484 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-3b287ee0-0580-4399-a796-ca6f56e35d48 admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:10:09.585855 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-3b287ee0-0580-4399-a796-ca6f56e35d48 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:10:09.586349 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-3b287ee0-0580-4399-a796-ca6f56e35d48 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:10:09.586766 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-3b287ee0-0580-4399-a796-ca6f56e35d48 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:10:09.587489 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-3b287ee0-0580-4399-a796-ca6f56e35d48 admin admin] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:10:09.587921 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-3b287ee0-0580-4399-a796-ca6f56e35d48 admin admin] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:10:09.588328 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-3b287ee0-0580-4399-a796-ca6f56e35d48 admin admin] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:10:09.608439 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-3b287ee0-0580-4399-a796-ca6f56e35d48 admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.076421 Aug 31 19:10:09.608982 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 36/72] 10.222.0.65 () {60 vars in 1193 bytes} [Wed Aug 31 19:10:09 2022] GET /compute/v2.1/os-services => generated 794 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 19:10:20.836283 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-c69104d9-312f-4cbd-be90-db9511150ef6 admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:10:20.837329 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-c69104d9-312f-4cbd-be90-db9511150ef6 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Aug 31 19:10:20.837730 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 37/73] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Aug 31 19:10:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:10:20.981965 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG dbcounter [-] [105611] Writing DB stats nova_cell0:SELECT=4 {{(pid=105611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:20.982682 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG dbcounter [-] [105611] Writing DB stats nova_cell1:SELECT=4 {{(pid=105611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:20.983292 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG dbcounter [-] [105611] Writing DB stats nova_api:SELECT=8 {{(pid=105611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:21.031311 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-410ff10f-b8a4-4a65-babe-60e373d14d29 admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:10:21.034670 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-410ff10f-b8a4-4a65-babe-60e373d14d29 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:10:21.035137 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-410ff10f-b8a4-4a65-babe-60e373d14d29 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:10:21.036049 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-410ff10f-b8a4-4a65-babe-60e373d14d29 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:10:21.036744 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-410ff10f-b8a4-4a65-babe-60e373d14d29 admin admin] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:10:21.037176 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-410ff10f-b8a4-4a65-babe-60e373d14d29 admin admin] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:10:21.037602 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-410ff10f-b8a4-4a65-babe-60e373d14d29 admin admin] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:10:21.062536 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-410ff10f-b8a4-4a65-babe-60e373d14d29 admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.084889 Aug 31 19:10:21.063026 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 37/74] 10.222.0.65 () {60 vars in 1193 bytes} [Wed Aug 31 19:10:20 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:10:21.889536 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-c69104d9-312f-4cbd-be90-db9511150ef6 admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:10:21.890568 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-c69104d9-312f-4cbd-be90-db9511150ef6 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001539 Aug 31 19:10:21.890964 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 38/75] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Aug 31 19:10:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:10:22.086566 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-660b0f88-9f55-44f2-9fa0-d13af68c0552 admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:10:22.090007 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-660b0f88-9f55-44f2-9fa0-d13af68c0552 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:10:22.090504 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-660b0f88-9f55-44f2-9fa0-d13af68c0552 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:10:22.090918 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-660b0f88-9f55-44f2-9fa0-d13af68c0552 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:10:22.091612 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-660b0f88-9f55-44f2-9fa0-d13af68c0552 admin admin] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:10:22.092069 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-660b0f88-9f55-44f2-9fa0-d13af68c0552 admin admin] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:10:22.092475 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-660b0f88-9f55-44f2-9fa0-d13af68c0552 admin admin] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:10:22.119249 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-660b0f88-9f55-44f2-9fa0-d13af68c0552 admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.083377 Aug 31 19:10:22.119730 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 38/76] 10.222.0.65 () {60 vars in 1193 bytes} [Wed Aug 31 19:10:22 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:11:21.090766 dv-cinder-835384-26-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 31 19:11:21.091383 dv-cinder-835384-26-iscsi devstack@n-api.service[105610]: Wed Aug 31 19:11:21 2022 - graceful shutdown triggered... Aug 31 19:11:21.091856 dv-cinder-835384-26-iscsi devstack@n-api.service[105611]: Gracefully killing worker 1 (pid: 105611)... Aug 31 19:11:21.092216 dv-cinder-835384-26-iscsi devstack@n-api.service[105612]: Gracefully killing worker 2 (pid: 105612)... Aug 31 19:11:22.092244 dv-cinder-835384-26-iscsi devstack@n-api.service[105610]: worker 1 buried after 1 seconds Aug 31 19:11:22.092807 dv-cinder-835384-26-iscsi devstack@n-api.service[105610]: worker 2 buried after 1 seconds Aug 31 19:11:22.092807 dv-cinder-835384-26-iscsi devstack@n-api.service[105610]: goodbye to uWSGI. Aug 31 19:11:22.093849 dv-cinder-835384-26-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 31 19:11:22.094413 dv-cinder-835384-26-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 31 19:11:22.097240 dv-cinder-835384-26-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 31 19:11:22.107211 dv-cinder-835384-26-iscsi devstack@n-api.service[120610]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 31 19:11:22.109308 dv-cinder-835384-26-iscsi devstack@n-api.service[120610]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 19:11:22 2022] *** Aug 31 19:11:22.109308 dv-cinder-835384-26-iscsi devstack@n-api.service[120610]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 19:11:22.109308 dv-cinder-835384-26-iscsi devstack@n-api.service[120610]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 19:11:22.109308 dv-cinder-835384-26-iscsi devstack@n-api.service[120610]: nodename: dv-cinder-835384-26-iscsi Aug 31 19:11:22.109308 dv-cinder-835384-26-iscsi devstack@n-api.service[120610]: machine: x86_64 Aug 31 19:11:22.109308 dv-cinder-835384-26-iscsi devstack@n-api.service[120610]: clock source: unix Aug 31 19:11:22.109308 dv-cinder-835384-26-iscsi devstack@n-api.service[120610]: pcre jit disabled Aug 31 19:11:22.109308 dv-cinder-835384-26-iscsi devstack@n-api.service[120610]: detected number of CPU cores: 4 Aug 31 19:11:22.109308 dv-cinder-835384-26-iscsi devstack@n-api.service[120610]: current working directory: / Aug 31 19:11:22.109308 dv-cinder-835384-26-iscsi devstack@n-api.service[120610]: detected binary path: /usr/bin/uwsgi-core Aug 31 19:11:22.109308 dv-cinder-835384-26-iscsi devstack@n-api.service[120610]: your processes number limit is 47680 Aug 31 19:11:22.109308 dv-cinder-835384-26-iscsi devstack@n-api.service[120610]: your memory page size is 4096 bytes Aug 31 19:11:22.109308 dv-cinder-835384-26-iscsi devstack@n-api.service[120610]: detected max file descriptor number: 2048 Aug 31 19:11:22.109308 dv-cinder-835384-26-iscsi devstack@n-api.service[120610]: lock engine: pthread robust mutexes Aug 31 19:11:22.110172 dv-cinder-835384-26-iscsi devstack@n-api.service[120610]: thunder lock: enabled Aug 31 19:11:22.110172 dv-cinder-835384-26-iscsi devstack@n-api.service[120610]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 31 19:11:22.110172 dv-cinder-835384-26-iscsi devstack@n-api.service[120610]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 19:11:22.149627 dv-cinder-835384-26-iscsi devstack@n-api.service[120610]: Python main interpreter initialized at 0x555c796dc9c0 Aug 31 19:11:22.149627 dv-cinder-835384-26-iscsi devstack@n-api.service[120610]: python threads support enabled Aug 31 19:11:22.149627 dv-cinder-835384-26-iscsi devstack@n-api.service[120610]: your server socket listen backlog is limited to 100 connections Aug 31 19:11:22.149627 dv-cinder-835384-26-iscsi devstack@n-api.service[120610]: your mercy for graceful operations on workers is 90 seconds Aug 31 19:11:22.150074 dv-cinder-835384-26-iscsi devstack@n-api.service[120610]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 19:11:22.150074 dv-cinder-835384-26-iscsi devstack@n-api.service[120610]: *** Operational MODE: preforking *** Aug 31 19:11:22.150321 dv-cinder-835384-26-iscsi devstack@n-api.service[120610]: *** uWSGI is running in multiple interpreter mode *** Aug 31 19:11:22.150321 dv-cinder-835384-26-iscsi devstack@n-api.service[120610]: spawned uWSGI master process (pid: 120610) Aug 31 19:11:22.150547 dv-cinder-835384-26-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 31 19:11:22.151086 dv-cinder-835384-26-iscsi devstack@n-api.service[120610]: spawned uWSGI worker 1 (pid: 120623, cores: 1) Aug 31 19:11:22.151430 dv-cinder-835384-26-iscsi devstack@n-api.service[120610]: spawned uWSGI worker 2 (pid: 120624, cores: 1) Aug 31 19:11:22.153227 dv-cinder-835384-26-iscsi devstack@n-api.service[120610]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 19:11:22.821751 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 19:11:22.822453 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 19:11:23.972312 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 19:11:23.972312 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: from cryptography.utils import int_from_bytes Aug 31 19:11:23.972954 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 19:11:23.972954 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: from cryptography.utils import int_from_bytes Aug 31 19:11:23.975246 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 19:11:23.975246 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: from cryptography.utils import int_from_bytes Aug 31 19:11:23.975682 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 19:11:23.975682 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: from cryptography.utils import int_from_bytes Aug 31 19:11:26.378706 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 19:11:26.379272 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 19:11:26.379526 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 19:11:26.379859 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 19:11:26.380113 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 19:11:26.380509 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.380870 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.381149 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.381495 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.381830 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.382143 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.382458 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.382788 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.383111 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.383368 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.383686 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.384013 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835384-26-iscsi {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.384494 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.384805 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.385349 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.385674 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.386650 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.387120 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.387293 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.387802 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.388247 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.388557 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.388871 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.389234 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.389569 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.389862 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.390180 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.390488 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.390814 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.391123 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.391526 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835384-26-iscsi {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.391844 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.392168 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.392491 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.392904 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.393220 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.393532 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.393852 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.394197 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.394505 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.394831 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.395146 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.395464 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.395779 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.396080 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.396386 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.396630 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 19:11:26.397079 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.397158 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 19:11:26.397275 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.397358 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.397438 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 19:11:26.397602 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.397779 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 19:11:26.397885 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.398037 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 19:11:26.398143 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.398427 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.398530 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.398753 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.398848 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.399070 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.399173 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.399318 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.399426 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.399564 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.399709 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.399882 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.400022 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.400199 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.400345 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.400505 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.400666 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.400810 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.400993 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.401111 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.401283 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.401433 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.401637 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.401755 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.401965 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835384-26-iscsi {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.402076 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.402350 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.402462 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.402655 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.402772 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.402971 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.403076 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.403284 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.403385 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.403602 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.403706 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.403906 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.404000 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.404229 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.404331 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.404623 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.404750 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.404870 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.405066 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.405170 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.405403 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.405510 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.405718 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.405832 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.406060 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.406166 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.406377 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.406478 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.406690 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.406791 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.407012 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.407104 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.407319 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.407420 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.407623 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.407726 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.407941 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.408040 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.408272 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.408381 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835384-26-iscsi {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.408577 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.408677 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.408825 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.408948 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.409126 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.409317 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.409456 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.409776 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.409869 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.410645 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.410770 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.410848 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.410927 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.411000 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.411080 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.411159 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.411240 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.411313 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.411490 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.411598 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.411802 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.411906 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.412117 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.412207 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.412422 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.412526 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.412728 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.412820 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.413033 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.413126 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.413360 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.413444 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.413666 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.413764 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.415024 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.415145 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.415145 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.415308 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.415393 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.415488 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.415581 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.415674 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.415819 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.415916 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.416016 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.416110 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.416196 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.416280 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.416377 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.416472 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.416558 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.416650 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.416742 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.416845 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.416931 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.417015 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.417160 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.418137 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.418280 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.418369 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.418443 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.418531 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.418626 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.418720 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.418819 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.418906 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.418906 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.419069 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.419160 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.419254 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.419417 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.419506 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.419649 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.419781 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.419957 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.420076 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.420258 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.420426 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.420560 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.420762 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.420856 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.421076 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.421207 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.421426 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.421549 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.421750 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.421864 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.422051 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.422167 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.422366 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.422463 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.422685 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.422781 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.422994 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.423101 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.423299 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.423394 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.423603 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.423705 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.423922 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.424025 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.424235 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.424336 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.424547 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.424665 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.424855 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.424958 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.425176 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.425360 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.425533 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.425640 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.425870 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.425983 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.426079 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.426173 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.426381 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.426485 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.426687 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.426788 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.427010 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.427104 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.427320 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.427433 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.427628 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.427722 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.427936 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.428030 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.428237 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.428340 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.428543 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.428637 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.428849 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.428950 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.429163 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.429279 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.429486 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.429592 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.429791 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.429885 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.430100 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.430194 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.430407 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.430500 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.430714 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.430814 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.431018 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.431120 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.431335 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.431436 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.431657 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.431749 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.431969 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.432064 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.432279 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.432381 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.432589 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.432715 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.433483 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.433579 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.433798 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.433909 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.434108 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.434210 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.434417 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.434512 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.434745 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.434854 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.435081 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.435216 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.435386 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.435488 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.435705 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.435849 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.436010 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.436115 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.436319 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.436422 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.436628 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.436721 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.436926 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.437027 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.437263 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.437400 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.437565 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.437659 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.437869 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.437972 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.438177 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.438322 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.438484 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.438594 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.438787 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.438881 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.439091 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.439192 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.439395 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.439498 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.439697 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.439801 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.439999 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.440101 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.440301 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.440410 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.440606 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.440699 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.440910 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.441011 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.441237 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.441336 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.441545 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.441640 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.441851 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.441999 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.442152 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.442251 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:11:26.442474 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.442570 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.442802 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.442916 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.443106 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.443201 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.443437 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.443531 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.443744 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.443847 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.444053 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.444146 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.444363 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.444464 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.444678 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.444785 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.444982 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.445069 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.445468 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.445571 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.445670 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.445836 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.445933 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.446079 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.446212 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.446314 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.446522 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.446625 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.446828 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.446922 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.447148 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.447241 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.447451 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.447544 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.447756 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.447858 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.448069 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.448163 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.448396 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.449014 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.449261 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.449363 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.449576 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.449716 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.449885 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.450031 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.450211 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.450307 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.450521 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.450629 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.450831 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.450924 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.451164 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.451257 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.451494 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.451600 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.451800 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.451901 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.452128 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.452244 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.452451 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.452587 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.452768 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.452867 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.453070 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.453228 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.453406 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.453713 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.453885 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.454016 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.454219 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.454322 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.454548 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.454643 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.454873 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.454989 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.455294 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.455405 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.455489 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.455562 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.455832 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.455939 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.456082 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.456182 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.456402 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.456498 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.456710 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.456814 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.457014 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.457109 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.457339 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.457447 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.457641 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.457740 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.458043 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.458157 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.458331 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.458423 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.458594 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.458692 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.458907 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.459013 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.459238 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.459335 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.459542 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.459646 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.459855 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.459997 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.460171 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.460279 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.460482 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.460587 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.460791 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.460897 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.461101 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.461232 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.461444 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.461551 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.461764 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.461873 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.462076 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.462222 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.462396 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.462513 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.462708 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.462812 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.463020 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.463122 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.463328 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.463422 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.463639 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.463742 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.463940 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.464056 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.464284 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.464387 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.464594 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.464688 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.464907 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.465009 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.465334 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.465444 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.465611 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.465720 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.465920 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.466014 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.466232 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.466458 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.466564 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.466770 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.466866 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.467125 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.467227 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.467430 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.467524 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.467747 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.467847 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.468057 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.468151 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.468368 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.468468 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.468672 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.468813 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.468994 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.469171 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.469408 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.469510 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.469628 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.469730 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.469931 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.470115 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.470245 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.470517 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.470686 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.470831 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.470924 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.471187 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.471282 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.471498 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.471661 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.471822 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.471997 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.472103 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.472266 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.472409 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.472581 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.472735 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.472880 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.473024 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.473207 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.473352 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.473494 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.473661 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.473810 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.473973 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.474232 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.474325 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.474577 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.474886 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.474987 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.475201 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.475319 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.475514 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.475816 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.476119 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.476367 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.476532 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.476701 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.476857 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.477001 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.477154 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.477369 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.477463 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.477587 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.477689 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.477947 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.478107 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.478268 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.478408 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.478561 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.478714 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.478866 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.479018 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.479189 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.479335 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.479527 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.479724 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.479907 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.480074 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.480218 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.480363 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.480516 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.480678 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.480828 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.480981 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.481134 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.481307 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.481452 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.481603 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.481752 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.481904 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.482046 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.482194 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.482338 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.482490 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.482661 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.482810 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.482952 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.483100 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.483252 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.483393 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.483550 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.483695 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.483835 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.483978 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.484128 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.484277 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.484427 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.484580 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.484741 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.484902 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.485050 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.485219 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.485375 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.485565 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.485707 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.485797 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.485881 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.486334 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.486468 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.486649 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.486772 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.486965 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.487069 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.487365 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.487549 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.487679 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.487885 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.487984 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.488204 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.488319 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.488527 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.488630 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.488847 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.488940 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.489243 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.489352 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.489539 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.489658 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.489863 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.489956 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.490173 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.490275 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.490478 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.490569 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.490788 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.490881 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.491095 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.491186 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.491399 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.491489 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.491709 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.491801 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.492016 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.492115 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.492321 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.492430 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.492626 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.492724 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.492934 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.493046 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.493266 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.493381 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.493573 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.493666 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.493877 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.493977 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.494184 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.494288 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.494494 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.494585 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.494802 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.494901 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.495113 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.495218 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.495987 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.496096 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.496238 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.496331 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.496548 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.496717 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.496870 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.497016 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.497158 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.497302 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.497463 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.497567 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.497806 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.497934 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.498111 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.498446 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.498968 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.499317 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.499871 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.500010 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.500125 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.500347 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.500481 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.500604 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.500717 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.500828 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.500940 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.501102 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.501246 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.501379 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.501503 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.501616 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.501760 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.501902 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.502167 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.502314 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.502484 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.502801 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.503115 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.503454 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.503734 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.504061 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.504515 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.504689 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.504689 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.504968 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.505101 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.505371 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.505514 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.505645 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.505783 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.506103 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.506241 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.506378 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.506507 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.506642 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.506823 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.506962 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.507292 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.507443 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.507582 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.507720 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.507863 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.508000 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.508128 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.508263 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.508406 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.508534 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.508689 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.508689 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.509006 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.509141 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.509299 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.509491 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.509628 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.509756 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.509891 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.510026 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.510155 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.510291 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.510416 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.510550 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.510685 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.510813 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.511068 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.511757 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.511894 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.512030 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.512166 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.512323 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.512455 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.512596 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.512739 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.512866 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.513002 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.513163 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.513358 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.513526 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.513660 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.513862 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.514009 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.514181 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.514322 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.514493 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.514629 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.514804 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.514948 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.515114 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.515250 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.515419 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.515551 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.515739 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.515870 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.516004 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.516287 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.516426 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.516554 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.516690 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.516826 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.516954 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.517079 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.517228 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.517528 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.517680 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.517810 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.517938 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.518066 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.518196 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.518322 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.518461 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.519578 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.519815 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.520040 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.520255 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.520480 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.520681 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.520899 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.521117 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.521360 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.521360 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.521770 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.521974 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.522177 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.522375 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.522571 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.522773 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.522988 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.523189 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.523404 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.523609 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.523809 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.524000 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.524222 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.524416 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.524612 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.524612 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.524972 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.525174 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.525406 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.525594 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.525777 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.525976 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.526172 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.526708 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.526896 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.527078 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.527267 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.527468 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.528027 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.528226 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.528398 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.528575 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.528760 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.528946 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.533321 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.533675 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.533852 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.534023 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.534186 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.534348 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.534512 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.534670 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.534819 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.534967 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.535122 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.535269 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.535425 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.535572 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.535729 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.535883 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.536144 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.536331 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.536502 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.536654 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.536808 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.536962 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.537121 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.537306 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.537466 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.537614 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.537759 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.537929 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.538083 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.538239 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.538393 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.538539 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.538685 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.538838 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.538990 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.539144 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.539314 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.539469 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.539667 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.539822 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.539984 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.540144 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.540293 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.540438 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.540583 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.540746 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.541260 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.541438 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.541588 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.541733 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.541878 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.542023 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.542724 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.542967 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.543231 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.543395 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.543542 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.543786 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.543948 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.544103 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.544103 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.544406 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.544562 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.544716 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.544716 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.545027 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.545027 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.545377 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.545527 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.545681 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.545836 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.545983 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.546136 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.546282 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.546427 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.546586 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.546734 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.546886 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.547050 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.547203 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.547350 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.547509 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.547656 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.547802 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.547948 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.548102 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.548102 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.548401 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.548555 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.548702 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.548855 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.549012 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.549165 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.549348 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.549497 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.549643 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.549835 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.549985 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.550145 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.550300 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.550447 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.550594 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.550739 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.550739 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.551038 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.551203 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.551433 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.551594 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.551750 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.551897 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.552051 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.552198 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.552343 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.552488 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.552640 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.552792 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.552982 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.553237 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.553466 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.553617 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.553781 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.554085 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.554246 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.554404 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.554559 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.554706 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.554851 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.555012 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.555167 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.555332 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.555479 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.555623 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.555777 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.555937 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.556092 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.556245 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.556245 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.556521 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.556666 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.556824 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.556971 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.557124 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.557315 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.557464 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.557623 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.557830 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.557999 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.558646 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.558801 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.558947 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.559107 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.559255 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.559399 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.559645 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.559863 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.560018 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.560180 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.560328 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.560473 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.560619 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.560763 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.560916 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.561075 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.561278 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.561461 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.561698 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.561857 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.562029 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.562176 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.562329 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.562474 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.562628 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.562780 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.562940 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.563087 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.563331 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.563509 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.563733 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.563896 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.564137 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.564301 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.564459 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.564616 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.564772 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.564772 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.565056 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.565222 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.565376 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.565523 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.565684 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.565838 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.565984 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.566136 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.566296 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.566451 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.566606 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.566761 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.566906 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.567058 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.567212 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.567212 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.567499 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.567499 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.567781 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.567928 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.568083 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.568242 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.568390 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.568536 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.568689 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.568835 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.568987 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.568987 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.569334 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.569482 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.569636 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.569636 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.569984 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.570163 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.570310 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.570310 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.570594 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.570749 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.570896 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.571054 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.571209 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.571362 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.571509 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.571674 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.571910 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.571910 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.572219 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.572374 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.572527 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.572674 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.572829 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.572982 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.573128 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.573314 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.573555 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.573727 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.573961 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.574139 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.574372 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.574525 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.574672 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.574826 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.574987 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.575135 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.575280 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.575433 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.575713 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.575880 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.576030 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.576184 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.576331 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.576487 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.576640 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.576873 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.577024 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.577170 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.577352 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.577498 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.577644 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.577802 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.577956 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.578104 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.578249 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.578394 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.578556 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.578716 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.578870 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.579031 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.579031 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.579323 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.579477 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.579632 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.579777 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.579922 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.580118 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.580270 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.580270 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.580566 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.580720 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.580873 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.581025 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.581179 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.581368 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.581516 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.581661 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.581806 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.582043 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.582210 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.582365 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.582528 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.582683 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.582829 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.582981 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.583140 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.583287 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.583433 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.583596 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.583821 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.583993 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.584224 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.584409 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.584628 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.584792 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.584939 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.585084 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.585298 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.585462 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.585616 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.585763 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.585914 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.586070 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.586224 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.586379 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.586531 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.586688 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.586834 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.586996 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.587142 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.587287 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.587433 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.587577 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.587731 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.587878 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.588023 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.588174 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.588327 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.588491 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.588647 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.588800 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.588946 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.589122 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.589292 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.589451 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.589618 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.589771 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.589926 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.590080 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.590276 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.590423 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.590590 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.590744 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.590897 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.591043 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.591187 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.591341 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.591488 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.591642 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.591794 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.591940 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.592175 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.592337 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.592507 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.592661 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.592808 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.592961 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.592961 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.593285 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.593448 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.593603 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.593757 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.594002 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.594161 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.594415 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.594576 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.594832 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.594994 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.595156 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.595317 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.595464 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.595616 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.595762 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.595908 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.596061 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.596216 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.596362 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.596507 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.596651 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.596808 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.596955 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.597161 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.597333 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.597333 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.597855 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.598011 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.598167 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.598322 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.598468 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.598613 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.598758 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.598914 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.599069 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.599069 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.599354 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.599506 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.599660 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.599814 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.599979 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.600166 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.600362 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.600519 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.600672 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.600826 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.600997 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.601152 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.601359 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.601514 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.601661 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.601820 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.601966 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.602112 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.602351 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.602503 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.602658 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.602658 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.602954 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.603121 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.603269 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.603455 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.603609 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.603769 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.603916 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.604153 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.604306 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.604559 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.605371 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.605596 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.605763 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.605912 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.606069 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.606222 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.606379 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.606533 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.606690 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.606845 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.606999 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.607154 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.607431 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.607591 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.607709 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.607830 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.607950 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.608072 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.608198 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.608312 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.608426 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.608546 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.608658 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.608785 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.608899 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.609020 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.609140 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.609316 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.609316 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.609835 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.610001 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.610183 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.610374 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.610527 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.610682 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.610839 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.611236 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.611394 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.611394 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.611681 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.611837 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.612004 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.612151 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.612303 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.612561 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.612721 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.612881 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.613029 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.613176 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.613358 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.613504 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.613662 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.613828 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.613992 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.614160 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.614446 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.614700 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.614856 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.615015 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.615015 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.615326 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.615557 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.615711 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.615872 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.616019 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.616163 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.616326 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.616326 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.616628 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.616785 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.616938 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.617092 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.617258 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.617422 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.617570 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.617799 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.617951 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.618096 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.618252 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.618406 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.618566 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.618719 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.618867 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.619022 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.619177 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.619323 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.619486 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.619647 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.619814 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.619976 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.620136 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.620394 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.621107 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.621323 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.621489 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.621642 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.621795 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.621947 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.622113 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.622274 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.622436 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.622688 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.622857 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.623043 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.623206 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.623368 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.623530 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.623683 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.623844 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.624006 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.624006 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.624304 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.624551 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.624726 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.624961 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.625136 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.625328 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.625482 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.625740 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.625911 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.626079 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.626241 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.626396 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.626556 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.626710 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.626863 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.627024 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.627180 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.627180 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.627491 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.627654 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.627808 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.627975 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.628131 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.628284 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.628444 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.628605 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.628757 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.628930 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.629084 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.629281 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.629461 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.629615 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.629782 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.629936 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.629936 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.630242 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.630405 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.630615 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.630788 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.630950 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.631110 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.631263 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.631416 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.631579 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.631741 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.631901 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.632054 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.632213 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.632366 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.632527 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.632699 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.632944 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.633102 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.633290 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.633448 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.633625 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.633787 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.633941 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.634094 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.634252 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.634406 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.634590 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.634827 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.635005 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.635251 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.635411 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.635572 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.635757 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.636029 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.636198 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.636352 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.637512 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.637684 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.637840 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.637999 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.638152 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.638305 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.638457 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.638618 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.638773 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.638773 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.639076 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.639236 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.639390 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.639612 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.639612 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.639915 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.640073 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.640225 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.640377 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.640772 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.640935 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.641095 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.641298 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.641456 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.641625 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.641779 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.641933 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.642093 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.642254 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.642416 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.642579 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.642741 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.642922 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.643171 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.643340 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.643506 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.643674 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.643836 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.643990 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.644143 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.644303 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.644456 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.644616 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.644770 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.645019 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.645237 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.645475 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.645650 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.645820 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.645998 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.646233 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.646390 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.646550 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.646712 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.646867 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.647018 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.647179 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.647332 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.647484 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.647644 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.647809 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.647961 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.648113 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.648267 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.648428 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.648590 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.648753 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.648906 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.649058 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.649238 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.649413 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.649568 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.649720 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.649883 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.650043 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.650198 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.650359 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.650521 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.650720 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.650881 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.651035 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.651201 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.651356 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.651553 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.651716 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.651888 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.652043 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.652209 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.652371 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.652527 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.652687 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.652847 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.653000 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.653180 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.653447 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.653619 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.653774 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.653945 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.654108 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.654261 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.654421 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.654576 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.654729 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.654880 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.655063 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.655299 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.655476 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.655712 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.655870 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.656024 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.656220 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.656220 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.656592 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.656592 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.656892 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.656892 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.657207 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.657207 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.657534 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.657696 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.657850 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.658015 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.658180 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.658340 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.658502 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.658655 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.658809 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.658809 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 19:11:26.659121 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.659121 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.659121 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.659121 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.659121 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.659121 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.659121 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.659121 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.660279 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.660279 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.660279 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.660279 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.660279 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.660279 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.660279 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.660279 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.661629 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.661629 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.661629 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.661629 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.661629 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.661629 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.661629 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.661629 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.662782 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.662782 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.662782 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.662782 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.662782 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.662782 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.662782 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.662782 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.664032 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.664032 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.664032 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.664032 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.664032 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.664032 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.664032 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.664032 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.665588 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.665588 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.665588 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.665588 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.665588 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.665588 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.665588 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.665588 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.668005 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.668005 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.668005 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.668005 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.668005 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.668005 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.668005 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.668005 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.669179 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.669179 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.669179 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.669179 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.669179 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.669179 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.669179 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.669179 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.670368 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.670368 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.670368 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.670368 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.670368 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.670368 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:11:26.670368 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 19:11:26.704765 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO dbcounter [None req-bbeecc6a-c6de-4eb8-8067-bb17e204f35e None None] Registered counter for database nova_api Aug 31 19:11:26.725927 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_db.sqlalchemy.engines [None req-bbeecc6a-c6de-4eb8-8067-bb17e204f35e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120624) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 19:11:26.727288 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO dbcounter [None req-b291d55e-1038-4d48-a31b-10c988f2f364 None None] Registered counter for database nova_api Aug 31 19:11:26.733451 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writer thread running {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 19:11:26.750597 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_db.sqlalchemy.engines [None req-b291d55e-1038-4d48-a31b-10c988f2f364 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120623) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 19:11:26.757386 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writer thread running {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 19:11:26.789799 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.context [None req-bbeecc6a-c6de-4eb8-8067-bb17e204f35e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),658714ec-07f2-4e1f-a605-05702ce30e13(cell1) {{(pid=120624) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 19:11:26.794347 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bbeecc6a-c6de-4eb8-8067-bb17e204f35e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:11:26.794822 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bbeecc6a-c6de-4eb8-8067-bb17e204f35e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:11:26.796397 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bbeecc6a-c6de-4eb8-8067-bb17e204f35e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:11:26.797129 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bbeecc6a-c6de-4eb8-8067-bb17e204f35e None None] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:11:26.797598 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bbeecc6a-c6de-4eb8-8067-bb17e204f35e None None] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:11:26.799572 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bbeecc6a-c6de-4eb8-8067-bb17e204f35e None None] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:11:26.801576 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO dbcounter [None req-bbeecc6a-c6de-4eb8-8067-bb17e204f35e None None] Registered counter for database nova_cell0 Aug 31 19:11:26.805581 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO dbcounter [None req-bbeecc6a-c6de-4eb8-8067-bb17e204f35e None None] Registered counter for database nova_cell1 Aug 31 19:11:26.813268 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_db.sqlalchemy.engines [None req-bbeecc6a-c6de-4eb8-8067-bb17e204f35e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120624) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 19:11:26.815989 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_db.sqlalchemy.engines [None req-bbeecc6a-c6de-4eb8-8067-bb17e204f35e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120624) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 19:11:26.817890 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.context [None req-b291d55e-1038-4d48-a31b-10c988f2f364 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),658714ec-07f2-4e1f-a605-05702ce30e13(cell1) {{(pid=120623) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 19:11:26.821148 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writer thread running {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 19:11:26.822057 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b291d55e-1038-4d48-a31b-10c988f2f364 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:11:26.822539 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b291d55e-1038-4d48-a31b-10c988f2f364 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:11:26.823193 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writer thread running {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 19:11:26.824218 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b291d55e-1038-4d48-a31b-10c988f2f364 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:11:26.824955 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b291d55e-1038-4d48-a31b-10c988f2f364 None None] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:11:26.825440 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b291d55e-1038-4d48-a31b-10c988f2f364 None None] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:11:26.827443 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b291d55e-1038-4d48-a31b-10c988f2f364 None None] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:11:26.829481 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO dbcounter [None req-b291d55e-1038-4d48-a31b-10c988f2f364 None None] Registered counter for database nova_cell0 Aug 31 19:11:26.833614 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO dbcounter [None req-b291d55e-1038-4d48-a31b-10c988f2f364 None None] Registered counter for database nova_cell1 Aug 31 19:11:26.840532 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_db.sqlalchemy.engines [None req-b291d55e-1038-4d48-a31b-10c988f2f364 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120623) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 19:11:26.842796 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_db.sqlalchemy.engines [None req-b291d55e-1038-4d48-a31b-10c988f2f364 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120623) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 19:11:26.848509 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writer thread running {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 19:11:26.849828 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writer thread running {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 19:11:26.970220 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO dbcounter [None req-bbeecc6a-c6de-4eb8-8067-bb17e204f35e None None] Registered counter for database nova_cell0 Aug 31 19:11:26.976996 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_db.sqlalchemy.engines [None req-bbeecc6a-c6de-4eb8-8067-bb17e204f35e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120624) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 19:11:26.982405 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writer thread running {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 19:11:26.999674 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO dbcounter [None req-b291d55e-1038-4d48-a31b-10c988f2f364 None None] Registered counter for database nova_cell0 Aug 31 19:11:27.006477 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_db.sqlalchemy.engines [None req-b291d55e-1038-4d48-a31b-10c988f2f364 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120623) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 19:11:27.010894 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writer thread running {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 19:11:27.299313 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: WARNING keystonemiddleware.auth_token [None req-bbeecc6a-c6de-4eb8-8067-bb17e204f35e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 19:11:27.306549 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: WARNING keystonemiddleware.auth_token [None req-bbeecc6a-c6de-4eb8-8067-bb17e204f35e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 19:11:27.335045 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: WARNING keystonemiddleware.auth_token [None req-b291d55e-1038-4d48-a31b-10c988f2f364 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 19:11:27.343036 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: WARNING keystonemiddleware.auth_token [None req-b291d55e-1038-4d48-a31b-10c988f2f364 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 19:11:27.653248 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: WARNING keystonemiddleware.auth_token [None req-bbeecc6a-c6de-4eb8-8067-bb17e204f35e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 19:11:27.659369 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: WARNING keystonemiddleware.auth_token [None req-bbeecc6a-c6de-4eb8-8067-bb17e204f35e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 19:11:27.664719 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555c796dc9c0 pid: 120624 (default app) Aug 31 19:11:27.688178 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: WARNING keystonemiddleware.auth_token [None req-b291d55e-1038-4d48-a31b-10c988f2f364 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 19:11:27.694241 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: WARNING keystonemiddleware.auth_token [None req-b291d55e-1038-4d48-a31b-10c988f2f364 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 19:11:27.700179 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555c796dc9c0 pid: 120623 (default app) Aug 31 19:12:02.972423 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_api:SELECT=3 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:02.973259 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=3 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:02.974594 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell0:SELECT=3 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:02.975942 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell0:SELECT=3 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:04.052225 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-bccb938e-7629-495f-9fd5-3d759889941e tempest-VolumesGetTestJSON-27061782 tempest-VolumesGetTestJSON-27061782-project] Action: 'create', calling method: .version_select at 0x7fdb873b3160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1281514481", "metadata": {"Type": "work"}}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:12:06.341584 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-bccb938e-7629-495f-9fd5-3d759889941e tempest-VolumesGetTestJSON-27061782 tempest-VolumesGetTestJSON-27061782-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.390844 Aug 31 19:12:06.343089 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 1/1] 10.222.0.65 () {60 vars in 1156 bytes} [Wed Aug 31 19:12:02 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3394 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 31 19:12:06.361228 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=3 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:06.362147 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=3 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:06.364056 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell0:SELECT=3 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:06.364869 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell0:SELECT=3 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:06.920382 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e9cf228b-7458-4f1e-b28b-3a15025b9d50 tempest-VolumesGetTestJSON-27061782 tempest-VolumesGetTestJSON-27061782-project] Calling method '.version_select at 0x7fdb87454ee0>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:08.285824 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-e9cf228b-7458-4f1e-b28b-3a15025b9d50 tempest-VolumesGetTestJSON-27061782 tempest-VolumesGetTestJSON-27061782-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/db4afca2-9f5d-43b4-b33a-18dcbf018c0b" status: 200 len: 354 microversion: 2.1 time: 1.931230 Aug 31 19:12:08.294706 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 1/2] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 31 19:12:06 2022] GET /compute/v2.1/os-volumes/db4afca2-9f5d-43b4-b33a-18dcbf018c0b => generated 354 bytes in 1942 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:12:08.300422 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-5e445938-8841-4585-8447-f481a5b1e32b tempest-VolumesGetTestJSON-27061782 tempest-VolumesGetTestJSON-27061782-project] Calling method '.version_select at 0x7fdb872a0040>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:08.890365 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-5e445938-8841-4585-8447-f481a5b1e32b tempest-VolumesGetTestJSON-27061782 tempest-VolumesGetTestJSON-27061782-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/db4afca2-9f5d-43b4-b33a-18dcbf018c0b" status: 200 len: 354 microversion: 2.1 time: 0.594693 Aug 31 19:12:08.891296 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 2/3] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 31 19:12:08 2022] GET /compute/v2.1/os-volumes/db4afca2-9f5d-43b4-b33a-18dcbf018c0b => generated 354 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:12:08.905945 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-5087ac03-55ed-4efb-b136-faf63b9d7c06 tempest-VolumesGetTestJSON-27061782 tempest-VolumesGetTestJSON-27061782-project] Calling method '.version_select at 0x7fdb872c7f70>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:09.341735 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-5087ac03-55ed-4efb-b136-faf63b9d7c06 tempest-VolumesGetTestJSON-27061782 tempest-VolumesGetTestJSON-27061782-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/db4afca2-9f5d-43b4-b33a-18dcbf018c0b" status: 202 len: 0 microversion: 2.1 time: 0.441043 Aug 31 19:12:09.343647 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 2/4] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Aug 31 19:12:08 2022] DELETE /compute/v2.1/os-volumes/db4afca2-9f5d-43b4-b33a-18dcbf018c0b => generated 0 bytes in 444 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:12:09.354581 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-c0c690cc-8f74-4c57-a0ae-a31a72b98b94 tempest-VolumesGetTestJSON-27061782 tempest-VolumesGetTestJSON-27061782-project] Calling method '.version_select at 0x7fdb872a0700>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:09.711346 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-c0c690cc-8f74-4c57-a0ae-a31a72b98b94 tempest-VolumesGetTestJSON-27061782 tempest-VolumesGetTestJSON-27061782-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/db4afca2-9f5d-43b4-b33a-18dcbf018c0b" status: 200 len: 353 microversion: 2.1 time: 0.362578 Aug 31 19:12:09.712088 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 3/5] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 31 19:12:09 2022] GET /compute/v2.1/os-volumes/db4afca2-9f5d-43b4-b33a-18dcbf018c0b => generated 353 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:12:10.728260 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-1e328b15-4ddd-4eae-b750-909c2b312a36 tempest-VolumesGetTestJSON-27061782 tempest-VolumesGetTestJSON-27061782-project] Calling method '.version_select at 0x7fdb87280670>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:10.952808 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.wsgi [None req-1e328b15-4ddd-4eae-b750-909c2b312a36 tempest-VolumesGetTestJSON-27061782 tempest-VolumesGetTestJSON-27061782-project] HTTP exception thrown: Volume db4afca2-9f5d-43b4-b33a-18dcbf018c0b could not be found. Aug 31 19:12:10.957375 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-1e328b15-4ddd-4eae-b750-909c2b312a36 tempest-VolumesGetTestJSON-27061782 tempest-VolumesGetTestJSON-27061782-project] Request method failure captured: Aug 31 19:12:10.957375 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: request: GET /compute/v2.1/os-volumes/db4afca2-9f5d-43b4-b33a-18dcbf018c0b HTTP/1.1 Aug 31 19:12:10.957375 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Accept: application/json Aug 31 19:12:10.957375 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Accept-Encoding: identity Aug 31 19:12:10.957375 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Connection: close Aug 31 19:12:10.957375 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Content-Length: 0 Aug 31 19:12:10.957375 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Content-Type: application/json Aug 31 19:12:10.957375 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Host: 10.222.0.65 Aug 31 19:12:10.957375 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Openstack-System-Scope: None Aug 31 19:12:10.957375 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: User-Agent: python-urllib3/1.26.12 Aug 31 19:12:10.957375 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Auth-Token: gAAAAABjD7KC6bSXMcUGa1dGCTqUvjnz0YzTC1zT8F7uhluigLgopnp5JK_idAY36qzj47kzEkCrBF6G5CxZLRL1HvD0G-DCfzmkx20iHfAe0Pe_3-1g-l1wTNTbCWcE-qGJLq4KO9-mxQ5bc-fqkro2cHf-VticqUndDT-ykan6R_EbDRBWHTU Aug 31 19:12:10.957375 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Domain-Id: None Aug 31 19:12:10.957375 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Domain-Name: None Aug 31 19:12:10.957375 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Identity-Status: Confirmed Aug 31 19:12:10.957375 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Is-Admin-Project: True Aug 31 19:12:10.957375 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Id: default Aug 31 19:12:10.957375 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Name: Default Aug 31 19:12:10.957375 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Id: 1b4974b4192c453e8824af0c0b2aaaab Aug 31 19:12:10.957375 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Name: tempest-VolumesGetTestJSON-27061782 Aug 31 19:12:10.957375 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Role: member,reader Aug 31 19:12:10.957375 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Roles: member,reader Aug 31 19:12:10.958723 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1b4974b4192c453e8824af0c0b2aaaab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1b4974b4192c453e8824af0c0b2aaaab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1b4974b4192c453e8824af0c0b2aaaab", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1b4974b4192c453e8824af0c0b2aaaab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:12:10.958723 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant: tempest-VolumesGetTestJSON-27061782 Aug 31 19:12:10.958723 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant-Id: 1b4974b4192c453e8824af0c0b2aaaab Aug 31 19:12:10.958723 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant-Name: tempest-VolumesGetTestJSON-27061782 Aug 31 19:12:10.958723 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User: tempest-VolumesGetTestJSON-27061782-project Aug 31 19:12:10.958723 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Id: default Aug 31 19:12:10.958723 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Name: Default Aug 31 19:12:10.958723 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Id: b9b0860b541a43278543b82b9e775bbb Aug 31 19:12:10.958723 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Name: tempest-VolumesGetTestJSON-27061782-project Aug 31 19:12:10.958723 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: method: Aug 31 19:12:10.958723 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: exception: Volume db4afca2-9f5d-43b4-b33a-18dcbf018c0b could not be found. Aug 31 19:12:10.958723 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: action_args: {'id': 'db4afca2-9f5d-43b4-b33a-18dcbf018c0b'} Aug 31 19:12:10.958723 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:12:10.959397 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:12:10.959397 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 19:12:10.959397 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 19:12:10.959397 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 19:12:10.959397 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 19:12:10.959397 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 19:12:10.959397 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 19:12:10.959397 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 19:12:10.959397 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 19:12:10.959397 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 19:12:10.959397 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 19:12:10.959397 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 19:12:10.959397 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 19:12:10.959397 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 19:12:10.959397 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 19:12:10.959397 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume db4afca2-9f5d-43b4-b33a-18dcbf018c0b could not be found. (HTTP 404) (Request-ID: req-18456397-74d7-4db4-8b66-603ae14fe8f5) Aug 31 19:12:10.959397 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:12:10.959397 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:12:10.959397 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:12:10.960328 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:12:10.960328 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 19:12:10.960328 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 19:12:10.960328 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 19:12:10.960328 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 19:12:10.960328 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 19:12:10.960328 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 19:12:10.960328 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 19:12:10.960328 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 19:12:10.960328 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 19:12:10.960328 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 19:12:10.960328 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 19:12:10.960328 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 19:12:10.960328 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 19:12:10.960328 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 19:12:10.960328 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 19:12:10.960328 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 19:12:10.960328 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 19:12:10.960328 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 19:12:10.961215 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 19:12:10.961215 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 19:12:10.961215 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 19:12:10.961215 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 19:12:10.961215 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume db4afca2-9f5d-43b4-b33a-18dcbf018c0b could not be found. Aug 31 19:12:10.961215 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:12:10.961215 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:12:10.961215 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:12:10.961215 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:12:10.961215 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:12:10.961215 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:12:10.961215 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:12:10.961215 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:12:10.961215 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 19:12:10.961215 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 19:12:10.961215 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:12:10.961215 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:12:10.961215 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 19:12:10.961215 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:12:10.962157 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume db4afca2-9f5d-43b4-b33a-18dcbf018c0b could not be found. Aug 31 19:12:10.962157 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:12:10.962157 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:12:10.962157 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:12:10.962157 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:12:10.962157 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:12:10.962157 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:12:10.962157 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:12:10.962157 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:12:10.962157 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume db4afca2-9f5d-43b4-b33a-18dcbf018c0b could not be found. Aug 31 19:12:10.962157 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:12:10.964536 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-1e328b15-4ddd-4eae-b750-909c2b312a36 tempest-VolumesGetTestJSON-27061782 tempest-VolumesGetTestJSON-27061782-project] Returning 404 to user: Volume db4afca2-9f5d-43b4-b33a-18dcbf018c0b could not be found. {{(pid=120623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:12:10.965677 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-1e328b15-4ddd-4eae-b750-909c2b312a36 tempest-VolumesGetTestJSON-27061782 tempest-VolumesGetTestJSON-27061782-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/db4afca2-9f5d-43b4-b33a-18dcbf018c0b" status: 404 len: 109 microversion: 2.1 time: 0.243372 Aug 31 19:12:10.976816 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 3/6] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 31 19:12:10 2022] GET /compute/v2.1/os-volumes/db4afca2-9f5d-43b4-b33a-18dcbf018c0b => generated 109 bytes in 253 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:12:15.015864 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-2935cb99-9fe4-4789-9176-53684ada0f2d tempest-VolumesNegativeTest-60732595 tempest-VolumesNegativeTest-60732595-project] Action: 'create', calling method: .version_select at 0x7fdb872a0ca0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1092383875", "metadata": {"Type": "work"}}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:12:15.021880 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-2935cb99-9fe4-4789-9176-53684ada0f2d tempest-VolumesNegativeTest-60732595 tempest-VolumesNegativeTest-60732595-project] Request method failure captured: Aug 31 19:12:15.021880 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 19:12:15.021880 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept: application/json Aug 31 19:12:15.021880 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Aug 31 19:12:15.021880 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Connection: close Aug 31 19:12:15.021880 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Length: 122 Aug 31 19:12:15.021880 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Type: application/json Aug 31 19:12:15.021880 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Host: 10.222.0.65 Aug 31 19:12:15.021880 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Aug 31 19:12:15.021880 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Aug 31 19:12:15.021880 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjD7KOUPSwehBPqoNTRZGWdaEJWHKKf4eMtzaYJqYN-P9oBmMW4qh2cPUgmyZjuhDjqzWQt6zpKcJBLAXtrTVBnQtwxcod6SMvbI_6koC-u8rnKBDfa7m8lwxJ7skdTBkgXie4FKiyYlKrdlEoWg9sJWESmr0jenPFW7ROs9_Hbc1KsQc Aug 31 19:12:15.021880 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Aug 31 19:12:15.021880 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Aug 31 19:12:15.021880 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Aug 31 19:12:15.021880 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Aug 31 19:12:15.021880 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Aug 31 19:12:15.021880 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Aug 31 19:12:15.021880 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Id: 9d8b9038e1c54375bf60744b9d41196f Aug 31 19:12:15.021880 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-VolumesNegativeTest-60732595 Aug 31 19:12:15.021880 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Role: member,reader Aug 31 19:12:15.021880 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Roles: member,reader Aug 31 19:12:15.022964 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/9d8b9038e1c54375bf60744b9d41196f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9d8b9038e1c54375bf60744b9d41196f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_9d8b9038e1c54375bf60744b9d41196f", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9d8b9038e1c54375bf60744b9d41196f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:12:15.022964 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-VolumesNegativeTest-60732595 Aug 31 19:12:15.022964 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Id: 9d8b9038e1c54375bf60744b9d41196f Aug 31 19:12:15.022964 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-VolumesNegativeTest-60732595 Aug 31 19:12:15.022964 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User: tempest-VolumesNegativeTest-60732595-project Aug 31 19:12:15.022964 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Aug 31 19:12:15.022964 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Aug 31 19:12:15.022964 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Id: 6d7a54c97fae4af49d1f77ed0c5a6e3a Aug 31 19:12:15.022964 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-VolumesNegativeTest-60732595-project Aug 31 19:12:15.022964 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Aug 31 19:12:15.022964 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1092383875", "metadata": {"Type": "work"}}} Aug 31 19:12:15.022964 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: method: Aug 31 19:12:15.022964 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 19:12:15.023623 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1092383875', 'metadata': {'Type': 'work'}}}} Aug 31 19:12:15.023623 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:12:15.023623 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:12:15.023623 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 19:12:15.023623 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 19:12:15.023623 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 19:12:15.023623 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise error Aug 31 19:12:15.023623 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 31 19:12:15.023623 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:12:15.023623 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 31 19:12:15.023623 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 19:12:15.023623 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:12:15.023623 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 19:12:15.023623 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi '#$%' Aug 31 19:12:15.023623 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:12:15.023623 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:12:15.023623 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:12:15.023623 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:12:15.023623 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:12:15.023623 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:12:15.023623 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:12:15.023623 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:12:15.024635 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 19:12:15.024635 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 19:12:15.024635 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:12:15.024635 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:12:15.024635 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 19:12:15.024635 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 19:12:15.024635 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 19:12:15.024635 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 19:12:15.024635 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 19:12:15.024635 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 19:12:15.024635 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 19:12:15.024635 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:12:15.024635 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:12:15.024635 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:12:15.024635 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:12:15.024635 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:12:15.024635 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:12:15.024635 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 19:12:15.024635 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 19:12:15.025559 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 19:12:15.025559 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:12:15.025559 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-2935cb99-9fe4-4789-9176-53684ada0f2d tempest-VolumesNegativeTest-60732595 tempest-VolumesNegativeTest-60732595-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:12:15.025559 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-2935cb99-9fe4-4789-9176-53684ada0f2d tempest-VolumesNegativeTest-60732595 tempest-VolumesNegativeTest-60732595-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.272182 Aug 31 19:12:15.025559 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 4/7] 10.222.0.65 () {60 vars in 1156 bytes} [Wed Aug 31 19:12:14 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 273 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 19:12:15.038771 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-6534d9cc-9346-4f77-963e-ec935425c756 tempest-VolumesNegativeTest-60732595 tempest-VolumesNegativeTest-60732595-project] Action: 'create', calling method: .version_select at 0x7fdb872a00d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-801520265", "metadata": {"Type": "work"}}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:12:15.053409 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-6534d9cc-9346-4f77-963e-ec935425c756 tempest-VolumesNegativeTest-60732595 tempest-VolumesNegativeTest-60732595-project] Request method failure captured: Aug 31 19:12:15.053409 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 19:12:15.053409 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept: application/json Aug 31 19:12:15.053409 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Aug 31 19:12:15.053409 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Connection: close Aug 31 19:12:15.053409 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Length: 119 Aug 31 19:12:15.053409 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Type: application/json Aug 31 19:12:15.053409 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Host: 10.222.0.65 Aug 31 19:12:15.053409 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Aug 31 19:12:15.053409 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Aug 31 19:12:15.053409 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjD7KOUPSwehBPqoNTRZGWdaEJWHKKf4eMtzaYJqYN-P9oBmMW4qh2cPUgmyZjuhDjqzWQt6zpKcJBLAXtrTVBnQtwxcod6SMvbI_6koC-u8rnKBDfa7m8lwxJ7skdTBkgXie4FKiyYlKrdlEoWg9sJWESmr0jenPFW7ROs9_Hbc1KsQc Aug 31 19:12:15.053409 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Aug 31 19:12:15.053409 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Aug 31 19:12:15.053409 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Aug 31 19:12:15.053409 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Aug 31 19:12:15.053409 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Aug 31 19:12:15.053409 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Aug 31 19:12:15.053409 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Id: 9d8b9038e1c54375bf60744b9d41196f Aug 31 19:12:15.053409 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-VolumesNegativeTest-60732595 Aug 31 19:12:15.053409 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Role: member,reader Aug 31 19:12:15.053409 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Roles: member,reader Aug 31 19:12:15.054722 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/9d8b9038e1c54375bf60744b9d41196f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9d8b9038e1c54375bf60744b9d41196f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_9d8b9038e1c54375bf60744b9d41196f", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9d8b9038e1c54375bf60744b9d41196f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:12:15.054722 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-VolumesNegativeTest-60732595 Aug 31 19:12:15.054722 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Id: 9d8b9038e1c54375bf60744b9d41196f Aug 31 19:12:15.054722 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-VolumesNegativeTest-60732595 Aug 31 19:12:15.054722 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User: tempest-VolumesNegativeTest-60732595-project Aug 31 19:12:15.054722 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Aug 31 19:12:15.054722 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Aug 31 19:12:15.054722 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Id: 6d7a54c97fae4af49d1f77ed0c5a6e3a Aug 31 19:12:15.054722 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-VolumesNegativeTest-60732595-project Aug 31 19:12:15.054722 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Aug 31 19:12:15.054722 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-801520265", "metadata": {"Type": "work"}}} Aug 31 19:12:15.054722 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: method: Aug 31 19:12:15.054722 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 19:12:15.055486 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-801520265', 'metadata': {'Type': 'work'}}}} Aug 31 19:12:15.055486 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:12:15.055486 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:12:15.055486 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 19:12:15.055486 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 19:12:15.055486 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 19:12:15.055486 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise error Aug 31 19:12:15.055486 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 31 19:12:15.055486 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:12:15.055486 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 31 19:12:15.055486 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 19:12:15.055486 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:12:15.055486 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 19:12:15.055486 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi '0' Aug 31 19:12:15.055486 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:12:15.055486 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:12:15.055486 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:12:15.055486 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:12:15.055486 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:12:15.055486 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:12:15.055486 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:12:15.055486 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:12:15.056754 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 19:12:15.056754 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 19:12:15.056754 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:12:15.056754 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:12:15.056754 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 19:12:15.056754 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 19:12:15.056754 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 19:12:15.056754 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 19:12:15.056754 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 19:12:15.056754 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 19:12:15.056754 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 19:12:15.056754 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:12:15.056754 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:12:15.056754 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:12:15.056754 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:12:15.056754 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:12:15.056754 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:12:15.056754 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 19:12:15.056754 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 19:12:15.058417 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 19:12:15.058417 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:12:15.061947 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-6534d9cc-9346-4f77-963e-ec935425c756 tempest-VolumesNegativeTest-60732595 tempest-VolumesNegativeTest-60732595-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:12:15.067953 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-6534d9cc-9346-4f77-963e-ec935425c756 tempest-VolumesNegativeTest-60732595 tempest-VolumesNegativeTest-60732595-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.033030 Aug 31 19:12:15.070636 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 5/8] 10.222.0.65 () {60 vars in 1156 bytes} [Wed Aug 31 19:12:15 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 19:12:15.093634 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-25d3899a-fd14-44ff-afda-2abc19e52fed tempest-VolumesNegativeTest-60732595 tempest-VolumesNegativeTest-60732595-project] Action: 'create', calling method: .version_select at 0x7fdb87264940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-206335045", "metadata": {"Type": "work"}}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:12:15.114595 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-25d3899a-fd14-44ff-afda-2abc19e52fed tempest-VolumesNegativeTest-60732595 tempest-VolumesNegativeTest-60732595-project] Request method failure captured: Aug 31 19:12:15.114595 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 19:12:15.114595 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept: application/json Aug 31 19:12:15.114595 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Aug 31 19:12:15.114595 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Connection: close Aug 31 19:12:15.114595 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Length: 118 Aug 31 19:12:15.114595 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Type: application/json Aug 31 19:12:15.114595 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Host: 10.222.0.65 Aug 31 19:12:15.114595 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Aug 31 19:12:15.114595 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Aug 31 19:12:15.114595 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjD7KOUPSwehBPqoNTRZGWdaEJWHKKf4eMtzaYJqYN-P9oBmMW4qh2cPUgmyZjuhDjqzWQt6zpKcJBLAXtrTVBnQtwxcod6SMvbI_6koC-u8rnKBDfa7m8lwxJ7skdTBkgXie4FKiyYlKrdlEoWg9sJWESmr0jenPFW7ROs9_Hbc1KsQc Aug 31 19:12:15.114595 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Aug 31 19:12:15.114595 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Aug 31 19:12:15.114595 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Aug 31 19:12:15.114595 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Aug 31 19:12:15.114595 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Aug 31 19:12:15.114595 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Aug 31 19:12:15.114595 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Id: 9d8b9038e1c54375bf60744b9d41196f Aug 31 19:12:15.114595 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-VolumesNegativeTest-60732595 Aug 31 19:12:15.114595 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Role: member,reader Aug 31 19:12:15.114595 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Roles: member,reader Aug 31 19:12:15.115859 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/9d8b9038e1c54375bf60744b9d41196f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9d8b9038e1c54375bf60744b9d41196f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_9d8b9038e1c54375bf60744b9d41196f", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9d8b9038e1c54375bf60744b9d41196f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:12:15.115859 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-VolumesNegativeTest-60732595 Aug 31 19:12:15.115859 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Id: 9d8b9038e1c54375bf60744b9d41196f Aug 31 19:12:15.115859 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-VolumesNegativeTest-60732595 Aug 31 19:12:15.115859 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User: tempest-VolumesNegativeTest-60732595-project Aug 31 19:12:15.115859 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Aug 31 19:12:15.115859 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Aug 31 19:12:15.115859 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Id: 6d7a54c97fae4af49d1f77ed0c5a6e3a Aug 31 19:12:15.115859 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-VolumesNegativeTest-60732595-project Aug 31 19:12:15.115859 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Aug 31 19:12:15.115859 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-206335045", "metadata": {"Type": "work"}}} Aug 31 19:12:15.115859 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: method: Aug 31 19:12:15.115859 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 19:12:15.116622 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-206335045', 'metadata': {'Type': 'work'}}}} Aug 31 19:12:15.116622 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:12:15.116622 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:12:15.116622 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 19:12:15.116622 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 19:12:15.116622 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 19:12:15.116622 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise error Aug 31 19:12:15.116622 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 31 19:12:15.116622 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:12:15.116622 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 31 19:12:15.116622 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 19:12:15.116622 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:12:15.116622 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 19:12:15.116622 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi '' Aug 31 19:12:15.116622 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:12:15.116622 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:12:15.116622 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:12:15.116622 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:12:15.116622 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:12:15.116622 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:12:15.116622 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:12:15.116622 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:12:15.117891 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 19:12:15.117891 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 19:12:15.117891 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:12:15.117891 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:12:15.117891 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 19:12:15.117891 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 19:12:15.117891 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 19:12:15.117891 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 19:12:15.117891 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 19:12:15.117891 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 19:12:15.117891 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 19:12:15.117891 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:12:15.117891 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:12:15.117891 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:12:15.117891 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:12:15.117891 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:12:15.117891 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:12:15.117891 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 19:12:15.117891 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 19:12:15.119069 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 19:12:15.119069 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:12:15.119996 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-25d3899a-fd14-44ff-afda-2abc19e52fed tempest-VolumesNegativeTest-60732595 tempest-VolumesNegativeTest-60732595-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:12:15.121099 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-25d3899a-fd14-44ff-afda-2abc19e52fed tempest-VolumesNegativeTest-60732595 tempest-VolumesNegativeTest-60732595-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.044812 Aug 31 19:12:15.124762 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 6/9] 10.222.0.65 () {60 vars in 1156 bytes} [Wed Aug 31 19:12:15 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 19:12:15.142631 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-ce8e374c-cbac-465f-bc99-3b99226de3c9 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1509514701", "imageRef": "f4f2ae76-bacc-4449-881b-f697e1eeec66", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:12:15.143420 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-58898655-de71-4f23-a1e1-fda155048003 tempest-VolumesNegativeTest-60732595 tempest-VolumesNegativeTest-60732595-project] Calling method '.version_select at 0x7fdb8729e310>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:15.210115 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.wsgi [None req-58898655-de71-4f23-a1e1-fda155048003 tempest-VolumesNegativeTest-60732595 tempest-VolumesNegativeTest-60732595-project] HTTP exception thrown: Volume tempest-invalid-1377959657 could not be found. Aug 31 19:12:15.215706 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-58898655-de71-4f23-a1e1-fda155048003 tempest-VolumesNegativeTest-60732595 tempest-VolumesNegativeTest-60732595-project] Request method failure captured: Aug 31 19:12:15.215706 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1377959657 HTTP/1.1 Aug 31 19:12:15.215706 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept: application/json Aug 31 19:12:15.215706 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Aug 31 19:12:15.215706 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Connection: close Aug 31 19:12:15.215706 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Length: 0 Aug 31 19:12:15.215706 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Type: application/json Aug 31 19:12:15.215706 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Host: 10.222.0.65 Aug 31 19:12:15.215706 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Aug 31 19:12:15.215706 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Aug 31 19:12:15.215706 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjD7KOUPSwehBPqoNTRZGWdaEJWHKKf4eMtzaYJqYN-P9oBmMW4qh2cPUgmyZjuhDjqzWQt6zpKcJBLAXtrTVBnQtwxcod6SMvbI_6koC-u8rnKBDfa7m8lwxJ7skdTBkgXie4FKiyYlKrdlEoWg9sJWESmr0jenPFW7ROs9_Hbc1KsQc Aug 31 19:12:15.215706 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Aug 31 19:12:15.215706 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Aug 31 19:12:15.215706 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Aug 31 19:12:15.215706 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Aug 31 19:12:15.215706 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Aug 31 19:12:15.215706 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Aug 31 19:12:15.215706 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Id: 9d8b9038e1c54375bf60744b9d41196f Aug 31 19:12:15.215706 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-VolumesNegativeTest-60732595 Aug 31 19:12:15.215706 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Role: member,reader Aug 31 19:12:15.215706 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Roles: member,reader Aug 31 19:12:15.216766 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/9d8b9038e1c54375bf60744b9d41196f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9d8b9038e1c54375bf60744b9d41196f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_9d8b9038e1c54375bf60744b9d41196f", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9d8b9038e1c54375bf60744b9d41196f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:12:15.216766 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-VolumesNegativeTest-60732595 Aug 31 19:12:15.216766 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Id: 9d8b9038e1c54375bf60744b9d41196f Aug 31 19:12:15.216766 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-VolumesNegativeTest-60732595 Aug 31 19:12:15.216766 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User: tempest-VolumesNegativeTest-60732595-project Aug 31 19:12:15.216766 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Aug 31 19:12:15.216766 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Aug 31 19:12:15.216766 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Id: 6d7a54c97fae4af49d1f77ed0c5a6e3a Aug 31 19:12:15.216766 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-VolumesNegativeTest-60732595-project Aug 31 19:12:15.216766 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: method: Aug 31 19:12:15.216766 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: exception: Volume tempest-invalid-1377959657 could not be found. Aug 31 19:12:15.216766 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: action_args: {'id': 'tempest-invalid-1377959657'} Aug 31 19:12:15.216766 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:12:15.217440 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:12:15.217440 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 19:12:15.217440 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 19:12:15.217440 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 19:12:15.217440 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 19:12:15.217440 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 19:12:15.217440 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 19:12:15.217440 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 19:12:15.217440 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 19:12:15.217440 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 19:12:15.217440 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 19:12:15.217440 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 19:12:15.217440 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 19:12:15.217440 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 19:12:15.217440 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 19:12:15.217440 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1377959657 could not be found. (HTTP 404) (Request-ID: req-91a31392-4f6c-42d2-8e3d-22d17ca97ca2) Aug 31 19:12:15.217440 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:12:15.217440 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:12:15.217440 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:12:15.218373 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:12:15.218373 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 19:12:15.218373 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 19:12:15.218373 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 19:12:15.218373 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 19:12:15.218373 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 19:12:15.218373 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 19:12:15.218373 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 19:12:15.218373 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 19:12:15.218373 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 19:12:15.218373 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 19:12:15.218373 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 19:12:15.218373 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 19:12:15.218373 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 19:12:15.218373 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 19:12:15.218373 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 19:12:15.218373 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 19:12:15.218373 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 19:12:15.218373 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 19:12:15.219266 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 19:12:15.219266 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 19:12:15.219266 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 19:12:15.219266 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 19:12:15.219266 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1377959657 could not be found. Aug 31 19:12:15.219266 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:12:15.219266 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:12:15.219266 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:12:15.219266 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:12:15.219266 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:12:15.219266 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:12:15.219266 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:12:15.219266 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:12:15.219266 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 19:12:15.219266 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 19:12:15.219266 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:12:15.219266 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:12:15.219266 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 19:12:15.219266 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:12:15.219266 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1377959657 could not be found. Aug 31 19:12:15.220191 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:12:15.220191 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:12:15.220191 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:12:15.220191 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:12:15.220191 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:12:15.220191 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:12:15.220191 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:12:15.220191 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:12:15.220191 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1377959657 could not be found. Aug 31 19:12:15.220191 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:12:15.226709 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-58898655-de71-4f23-a1e1-fda155048003 tempest-VolumesNegativeTest-60732595 tempest-VolumesNegativeTest-60732595-project] Returning 404 to user: Volume tempest-invalid-1377959657 could not be found. {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:12:15.227792 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-58898655-de71-4f23-a1e1-fda155048003 tempest-VolumesNegativeTest-60732595 tempest-VolumesNegativeTest-60732595-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1377959657" status: 404 len: 99 microversion: 2.1 time: 0.095815 Aug 31 19:12:15.228480 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 7/10] 10.222.0.65 () {58 vars in 1218 bytes} [Wed Aug 31 19:12:15 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1377959657 => generated 99 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 19:12:15.255683 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-2d2e73fd-2ca0-415e-919d-966554915ccf tempest-VolumesNegativeTest-60732595 tempest-VolumesNegativeTest-60732595-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.018320 Aug 31 19:12:15.258696 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 8/11] 10.222.0.65 () {58 vars in 1140 bytes} [Wed Aug 31 19:12:15 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 31 19:12:15.268416 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-228d60fc-fdc1-4f39-b5ab-a41743d4c5e5 tempest-VolumesNegativeTest-60732595 tempest-VolumesNegativeTest-60732595-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004040 Aug 31 19:12:15.272358 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 9/12] 10.222.0.65 () {58 vars in 1137 bytes} [Wed Aug 31 19:12:15 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 31 19:12:15.290591 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-1525ae12-3cf3-41c9-97dd-59447a66d1e3 tempest-VolumesNegativeTest-60732595 tempest-VolumesNegativeTest-60732595-project] Calling method '.version_select at 0x7fdb87264820>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:15.407861 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.wsgi [None req-1525ae12-3cf3-41c9-97dd-59447a66d1e3 tempest-VolumesNegativeTest-60732595 tempest-VolumesNegativeTest-60732595-project] HTTP exception thrown: Volume 44f6d06b-e62b-4766-a8a8-ba0002e19488 could not be found. Aug 31 19:12:15.409959 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-1525ae12-3cf3-41c9-97dd-59447a66d1e3 tempest-VolumesNegativeTest-60732595 tempest-VolumesNegativeTest-60732595-project] Request method failure captured: Aug 31 19:12:15.409959 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: request: DELETE /compute/v2.1/os-volumes/44f6d06b-e62b-4766-a8a8-ba0002e19488 HTTP/1.1 Aug 31 19:12:15.409959 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept: application/json Aug 31 19:12:15.409959 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Aug 31 19:12:15.409959 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Connection: close Aug 31 19:12:15.409959 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Length: 0 Aug 31 19:12:15.409959 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Type: application/json Aug 31 19:12:15.409959 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Host: 10.222.0.65 Aug 31 19:12:15.409959 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Aug 31 19:12:15.409959 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Aug 31 19:12:15.409959 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjD7KOUPSwehBPqoNTRZGWdaEJWHKKf4eMtzaYJqYN-P9oBmMW4qh2cPUgmyZjuhDjqzWQt6zpKcJBLAXtrTVBnQtwxcod6SMvbI_6koC-u8rnKBDfa7m8lwxJ7skdTBkgXie4FKiyYlKrdlEoWg9sJWESmr0jenPFW7ROs9_Hbc1KsQc Aug 31 19:12:15.409959 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Aug 31 19:12:15.409959 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Aug 31 19:12:15.409959 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Aug 31 19:12:15.409959 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Aug 31 19:12:15.409959 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Aug 31 19:12:15.409959 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Aug 31 19:12:15.409959 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Id: 9d8b9038e1c54375bf60744b9d41196f Aug 31 19:12:15.409959 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-VolumesNegativeTest-60732595 Aug 31 19:12:15.409959 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Role: member,reader Aug 31 19:12:15.409959 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Roles: member,reader Aug 31 19:12:15.411222 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/9d8b9038e1c54375bf60744b9d41196f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9d8b9038e1c54375bf60744b9d41196f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_9d8b9038e1c54375bf60744b9d41196f", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9d8b9038e1c54375bf60744b9d41196f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:12:15.411222 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-VolumesNegativeTest-60732595 Aug 31 19:12:15.411222 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Id: 9d8b9038e1c54375bf60744b9d41196f Aug 31 19:12:15.411222 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-VolumesNegativeTest-60732595 Aug 31 19:12:15.411222 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User: tempest-VolumesNegativeTest-60732595-project Aug 31 19:12:15.411222 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Aug 31 19:12:15.411222 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Aug 31 19:12:15.411222 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Id: 6d7a54c97fae4af49d1f77ed0c5a6e3a Aug 31 19:12:15.411222 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-VolumesNegativeTest-60732595-project Aug 31 19:12:15.411222 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: method: Aug 31 19:12:15.411222 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: exception: Volume 44f6d06b-e62b-4766-a8a8-ba0002e19488 could not be found. Aug 31 19:12:15.411222 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: action_args: {'id': '44f6d06b-e62b-4766-a8a8-ba0002e19488'} Aug 31 19:12:15.411222 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:12:15.411983 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:12:15.411983 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 19:12:15.411983 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 19:12:15.411983 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 19:12:15.411983 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 19:12:15.411983 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 19:12:15.411983 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 19:12:15.411983 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 19:12:15.411983 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 19:12:15.411983 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 19:12:15.411983 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 19:12:15.411983 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 19:12:15.411983 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 19:12:15.411983 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 19:12:15.411983 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 19:12:15.411983 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 44f6d06b-e62b-4766-a8a8-ba0002e19488 could not be found. (HTTP 404) (Request-ID: req-50e5ac5f-7c9f-46e0-be69-1a4d9eaed5ae) Aug 31 19:12:15.411983 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:12:15.411983 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:12:15.411983 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:12:15.413029 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:12:15.413029 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 19:12:15.413029 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 19:12:15.413029 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 19:12:15.413029 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 19:12:15.413029 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 19:12:15.413029 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 19:12:15.413029 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 19:12:15.413029 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 19:12:15.413029 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 19:12:15.413029 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 19:12:15.413029 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 19:12:15.413029 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 19:12:15.413029 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 19:12:15.413029 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 19:12:15.413029 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 19:12:15.413029 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 19:12:15.413029 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 19:12:15.413029 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 19:12:15.413931 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 19:12:15.413931 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 19:12:15.413931 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 19:12:15.413931 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 19:12:15.413931 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 44f6d06b-e62b-4766-a8a8-ba0002e19488 could not be found. Aug 31 19:12:15.413931 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:12:15.413931 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:12:15.413931 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:12:15.413931 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:12:15.413931 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:12:15.413931 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:12:15.413931 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:12:15.413931 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:12:15.413931 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 19:12:15.413931 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 19:12:15.413931 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:12:15.413931 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:12:15.413931 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 19:12:15.413931 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:12:15.415481 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 44f6d06b-e62b-4766-a8a8-ba0002e19488 could not be found. Aug 31 19:12:15.415481 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:12:15.415481 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:12:15.415481 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:12:15.415481 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:12:15.415481 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:12:15.415481 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:12:15.415481 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:12:15.415481 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:12:15.415481 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 44f6d06b-e62b-4766-a8a8-ba0002e19488 could not be found. Aug 31 19:12:15.415481 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:12:15.415481 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-1525ae12-3cf3-41c9-97dd-59447a66d1e3 tempest-VolumesNegativeTest-60732595 tempest-VolumesNegativeTest-60732595-project] Returning 404 to user: Volume 44f6d06b-e62b-4766-a8a8-ba0002e19488 could not be found. {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:12:15.415481 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-1525ae12-3cf3-41c9-97dd-59447a66d1e3 tempest-VolumesNegativeTest-60732595 tempest-VolumesNegativeTest-60732595-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/44f6d06b-e62b-4766-a8a8-ba0002e19488" status: 404 len: 109 microversion: 2.1 time: 0.133001 Aug 31 19:12:15.415481 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 10/13] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Aug 31 19:12:15 2022] DELETE /compute/v2.1/os-volumes/44f6d06b-e62b-4766-a8a8-ba0002e19488 => generated 109 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:12:15.425247 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-f017cabb-18c7-4e62-ae4c-8fc0eb6e2926 tempest-VolumesNegativeTest-60732595 tempest-VolumesNegativeTest-60732595-project] Calling method '.version_select at 0x7fdb871e81f0>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:15.486473 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.wsgi [None req-f017cabb-18c7-4e62-ae4c-8fc0eb6e2926 tempest-VolumesNegativeTest-60732595 tempest-VolumesNegativeTest-60732595-project] HTTP exception thrown: Volume 3b2b7526-8d98-430b-b1ce-af6d91bb00b0 could not be found. Aug 31 19:12:15.488713 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-f017cabb-18c7-4e62-ae4c-8fc0eb6e2926 tempest-VolumesNegativeTest-60732595 tempest-VolumesNegativeTest-60732595-project] Request method failure captured: Aug 31 19:12:15.488713 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: request: GET /compute/v2.1/os-volumes/3b2b7526-8d98-430b-b1ce-af6d91bb00b0 HTTP/1.1 Aug 31 19:12:15.488713 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept: application/json Aug 31 19:12:15.488713 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Aug 31 19:12:15.488713 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Connection: close Aug 31 19:12:15.488713 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Length: 0 Aug 31 19:12:15.488713 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Type: application/json Aug 31 19:12:15.488713 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Host: 10.222.0.65 Aug 31 19:12:15.488713 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Aug 31 19:12:15.488713 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Aug 31 19:12:15.488713 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjD7KOUPSwehBPqoNTRZGWdaEJWHKKf4eMtzaYJqYN-P9oBmMW4qh2cPUgmyZjuhDjqzWQt6zpKcJBLAXtrTVBnQtwxcod6SMvbI_6koC-u8rnKBDfa7m8lwxJ7skdTBkgXie4FKiyYlKrdlEoWg9sJWESmr0jenPFW7ROs9_Hbc1KsQc Aug 31 19:12:15.488713 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Aug 31 19:12:15.488713 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Aug 31 19:12:15.488713 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Aug 31 19:12:15.488713 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Aug 31 19:12:15.488713 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Aug 31 19:12:15.488713 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Aug 31 19:12:15.488713 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Id: 9d8b9038e1c54375bf60744b9d41196f Aug 31 19:12:15.488713 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-VolumesNegativeTest-60732595 Aug 31 19:12:15.488713 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Role: member,reader Aug 31 19:12:15.488713 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Roles: member,reader Aug 31 19:12:15.489990 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/9d8b9038e1c54375bf60744b9d41196f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9d8b9038e1c54375bf60744b9d41196f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_9d8b9038e1c54375bf60744b9d41196f", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9d8b9038e1c54375bf60744b9d41196f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:12:15.489990 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-VolumesNegativeTest-60732595 Aug 31 19:12:15.489990 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Id: 9d8b9038e1c54375bf60744b9d41196f Aug 31 19:12:15.489990 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-VolumesNegativeTest-60732595 Aug 31 19:12:15.489990 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User: tempest-VolumesNegativeTest-60732595-project Aug 31 19:12:15.489990 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Aug 31 19:12:15.489990 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Aug 31 19:12:15.489990 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Id: 6d7a54c97fae4af49d1f77ed0c5a6e3a Aug 31 19:12:15.489990 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-VolumesNegativeTest-60732595-project Aug 31 19:12:15.489990 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: method: Aug 31 19:12:15.489990 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: exception: Volume 3b2b7526-8d98-430b-b1ce-af6d91bb00b0 could not be found. Aug 31 19:12:15.489990 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: action_args: {'id': '3b2b7526-8d98-430b-b1ce-af6d91bb00b0'} Aug 31 19:12:15.489990 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:12:15.490847 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:12:15.490847 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 19:12:15.490847 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 19:12:15.490847 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 19:12:15.490847 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 19:12:15.490847 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 19:12:15.490847 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 19:12:15.490847 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 19:12:15.490847 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 19:12:15.490847 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 19:12:15.490847 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 19:12:15.490847 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 19:12:15.490847 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 19:12:15.490847 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 19:12:15.490847 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 19:12:15.490847 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3b2b7526-8d98-430b-b1ce-af6d91bb00b0 could not be found. (HTTP 404) (Request-ID: req-ee1bd9bf-fb84-4abd-9194-535ef06f53e4) Aug 31 19:12:15.490847 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:12:15.490847 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:12:15.490847 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:12:15.491870 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:12:15.491870 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 19:12:15.491870 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 19:12:15.491870 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 19:12:15.491870 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 19:12:15.491870 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 19:12:15.491870 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 19:12:15.491870 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 19:12:15.491870 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 19:12:15.491870 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 19:12:15.491870 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 19:12:15.491870 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 19:12:15.491870 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 19:12:15.491870 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 19:12:15.491870 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 19:12:15.491870 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 19:12:15.491870 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 19:12:15.491870 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 19:12:15.491870 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 19:12:15.492728 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 19:12:15.492728 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 19:12:15.492728 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 19:12:15.492728 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 19:12:15.492728 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3b2b7526-8d98-430b-b1ce-af6d91bb00b0 could not be found. Aug 31 19:12:15.492728 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:12:15.492728 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:12:15.492728 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:12:15.492728 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:12:15.492728 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:12:15.492728 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:12:15.492728 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:12:15.492728 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:12:15.492728 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 19:12:15.492728 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 19:12:15.492728 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:12:15.492728 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:12:15.492728 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 19:12:15.492728 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:12:15.493810 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3b2b7526-8d98-430b-b1ce-af6d91bb00b0 could not be found. Aug 31 19:12:15.493810 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:12:15.493810 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:12:15.493810 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:12:15.493810 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:12:15.493810 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:12:15.493810 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:12:15.493810 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:12:15.493810 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:12:15.493810 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3b2b7526-8d98-430b-b1ce-af6d91bb00b0 could not be found. Aug 31 19:12:15.493810 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:12:15.497082 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-f017cabb-18c7-4e62-ae4c-8fc0eb6e2926 tempest-VolumesNegativeTest-60732595 tempest-VolumesNegativeTest-60732595-project] Returning 404 to user: Volume 3b2b7526-8d98-430b-b1ce-af6d91bb00b0 could not be found. {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:12:15.498092 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-f017cabb-18c7-4e62-ae4c-8fc0eb6e2926 tempest-VolumesNegativeTest-60732595 tempest-VolumesNegativeTest-60732595-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/3b2b7526-8d98-430b-b1ce-af6d91bb00b0" status: 404 len: 109 microversion: 2.1 time: 0.081156 Aug 31 19:12:15.499232 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 11/14] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 31 19:12:15 2022] GET /compute/v2.1/os-volumes/3b2b7526-8d98-430b-b1ce-af6d91bb00b0 => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 19:12:15.504085 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.network.neutron [None req-ce8e374c-cbac-465f-bc99-3b99226de3c9 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] validate_networks() for [('5665d234-ccc2-49d8-a927-e4f4c8c9591b', None, None, None, None, None)] {{(pid=120623) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:12:17.028237 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-342de293-53d6-4334-99b0-2e5e77904175 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Action: 'create', calling method: .version_select at 0x7fdb8729e4c0>, body: {"keypair": {"name": "tempest-keypair-126454859", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoPDN1c+U0Fj4Gat1trB1S5k+iJSIIupXGIEs++u861Y6EkRta8VT7zjv1fKENf3kkwRrkBIrtGHA2O3cKhmdxCxMgSbzhzNBlVwmoNuBvaUjY8FaTFbNZ54ZGJx0Sgkg=="}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:12:17.083784 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-342de293-53d6-4334-99b0-2e5e77904175 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Getting quotas for project e6d782400f1e432c8d10a31334c42e68. Resources: {'key_pairs'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:12:17.091183 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-342de293-53d6-4334-99b0-2e5e77904175 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Getting quotas for user 0bfa1533b0944bd681f4c2a33cf701b0 and project e6d782400f1e432c8d10a31334c42e68. Resources: {'key_pairs'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:12:17.156342 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-342de293-53d6-4334-99b0-2e5e77904175 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.394392 Aug 31 19:12:17.161660 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 12/15] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Aug 31 19:12:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:12:17.610931 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-ce8e374c-cbac-465f-bc99-3b99226de3c9 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Flavor limits 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:12:17.611727 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-ce8e374c-cbac-465f-bc99-3b99226de3c9 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Image limits 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:12:17.612449 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-ce8e374c-cbac-465f-bc99-3b99226de3c9 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Flavor pref 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:12:17.613014 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-ce8e374c-cbac-465f-bc99-3b99226de3c9 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Image pref 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:12:17.613402 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-ce8e374c-cbac-465f-bc99-3b99226de3c9 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:12:17.668646 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ce8e374c-cbac-465f-bc99-3b99226de3c9 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:17.669815 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ce8e374c-cbac-465f-bc99-3b99226de3c9 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:17.671925 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ce8e374c-cbac-465f-bc99-3b99226de3c9 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:17.673494 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ce8e374c-cbac-465f-bc99-3b99226de3c9 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:17.674370 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ce8e374c-cbac-465f-bc99-3b99226de3c9 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:17.675046 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ce8e374c-cbac-465f-bc99-3b99226de3c9 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:17.830510 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.quota [None req-ce8e374c-cbac-465f-bc99-3b99226de3c9 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Getting quotas for project e3aa913bb25c45039643ce87bb84cbc2. Resources: {'instances', 'cores', 'ram'} {{(pid=120623) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:12:17.841059 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.quota [None req-ce8e374c-cbac-465f-bc99-3b99226de3c9 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Getting quotas for user aa81a686e4324370a20e3fc35e5cc7a5 and project e3aa913bb25c45039643ce87bb84cbc2. Resources: {'instances', 'cores', 'ram'} {{(pid=120623) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:12:17.877690 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-ce8e374c-cbac-465f-bc99-3b99226de3c9 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Going to run 1 instances... {{(pid=120623) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:12:17.882751 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-ce8e374c-cbac-465f-bc99-3b99226de3c9 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f4f2ae76-bacc-4449-881b-f697e1eeec66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120623) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:12:18.121460 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-ce8e374c-cbac-465f-bc99-3b99226de3c9 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.291157 Aug 31 19:12:18.134140 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-f14bc646-e899-4791-b41e-3eefc1757712 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:18.134886 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-f14bc646-e899-4791-b41e-3eefc1757712 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:18.144961 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 4/16] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 31 19:12:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 3316 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 19:12:18.487234 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-f14bc646-e899-4791-b41e-3eefc1757712 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:18.523751 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-f14bc646-e899-4791-b41e-3eefc1757712 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48" status: 200 len: 1222 microversion: 2.1 time: 0.393581 Aug 31 19:12:18.527336 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 13/17] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:18 2022] GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 => generated 1222 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:19.158712 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-23a110b3-18cc-4bb6-bf39-2485653476ce tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1296904537", "imageRef": "f4f2ae76-bacc-4449-881b-f697e1eeec66", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:12:19.310100 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.network.neutron [None req-23a110b3-18cc-4bb6-bf39-2485653476ce tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] validate_networks() for [('5665d234-ccc2-49d8-a927-e4f4c8c9591b', None, None, None, None, None)] {{(pid=120623) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:12:20.432458 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-23a110b3-18cc-4bb6-bf39-2485653476ce tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Flavor limits 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:12:20.433161 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-23a110b3-18cc-4bb6-bf39-2485653476ce tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Image limits 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:12:20.433779 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-23a110b3-18cc-4bb6-bf39-2485653476ce tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Flavor pref 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:12:20.434508 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-23a110b3-18cc-4bb6-bf39-2485653476ce tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Image pref 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:12:20.435111 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-23a110b3-18cc-4bb6-bf39-2485653476ce tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:12:20.454042 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-23a110b3-18cc-4bb6-bf39-2485653476ce tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:20.454545 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-23a110b3-18cc-4bb6-bf39-2485653476ce tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:20.454983 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-23a110b3-18cc-4bb6-bf39-2485653476ce tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:20.457838 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-23a110b3-18cc-4bb6-bf39-2485653476ce tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:20.458341 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-23a110b3-18cc-4bb6-bf39-2485653476ce tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:20.458769 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-23a110b3-18cc-4bb6-bf39-2485653476ce tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:20.499444 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.quota [None req-23a110b3-18cc-4bb6-bf39-2485653476ce tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Getting quotas for project e3aa913bb25c45039643ce87bb84cbc2. Resources: {'instances', 'cores', 'ram'} {{(pid=120623) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:12:20.510510 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.quota [None req-23a110b3-18cc-4bb6-bf39-2485653476ce tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Getting quotas for user aa81a686e4324370a20e3fc35e5cc7a5 and project e3aa913bb25c45039643ce87bb84cbc2. Resources: {'instances', 'cores', 'ram'} {{(pid=120623) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:12:20.545952 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-23a110b3-18cc-4bb6-bf39-2485653476ce tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Going to run 1 instances... {{(pid=120623) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:12:20.551471 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-23a110b3-18cc-4bb6-bf39-2485653476ce tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f4f2ae76-bacc-4449-881b-f697e1eeec66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120623) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:12:20.562563 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-0d2f3d38-faaa-40e2-a096-ffbebb5e4786 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-339112182", "imageRef": "f4f2ae76-bacc-4449-881b-f697e1eeec66", "flavorRef": "452", "networks": [{"uuid": "eb88c40a-9dcf-422f-a8ee-7e2394c4076e"}]}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:12:20.667247 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-23a110b3-18cc-4bb6-bf39-2485653476ce tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.522724 Aug 31 19:12:20.668092 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 5/18] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 31 19:12:19 2022] POST /compute/v2.1/servers => generated 383 bytes in 1530 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 19:12:20.682688 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-3f57e7a2-12a6-4107-b786-7c6ee6567cd8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:20.689537 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-3f57e7a2-12a6-4107-b786-7c6ee6567cd8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:20.866980 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.network.neutron [None req-0d2f3d38-faaa-40e2-a096-ffbebb5e4786 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] validate_networks() for [('eb88c40a-9dcf-422f-a8ee-7e2394c4076e', None, None, None, None, None)] {{(pid=120624) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:12:20.990829 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-3f57e7a2-12a6-4107-b786-7c6ee6567cd8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:21.044760 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-3f57e7a2-12a6-4107-b786-7c6ee6567cd8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1222 microversion: 2.1 time: 0.369410 Aug 31 19:12:21.047133 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 6/19] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:20 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1222 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:22.066971 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-5feea730-6559-427f-b0f6-489b83f88d6c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:22.068697 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-5feea730-6559-427f-b0f6-489b83f88d6c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:22.349654 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-5feea730-6559-427f-b0f6-489b83f88d6c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:22.366385 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-5feea730-6559-427f-b0f6-489b83f88d6c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1222 microversion: 2.1 time: 0.303326 Aug 31 19:12:22.369714 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 7/20] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:22 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1222 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:22.653431 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-cd57cda3-0e2c-4412-9c51-753272057686 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1220043962", "imageRef": "f4f2ae76-bacc-4449-881b-f697e1eeec66", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3d3f0557-9886-408b-a53b-c6736a0907d4"}], "security_groups": [{"name": "tempest-securitygroup--1854816599"}], "key_name": "tempest-keypair-126454859", "user_data": "}} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:12:22.944463 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.network.neutron [None req-cd57cda3-0e2c-4412-9c51-753272057686 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] validate_networks() for [('3d3f0557-9886-408b-a53b-c6736a0907d4', None, None, None, None, None)] {{(pid=120623) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:12:23.082643 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-0d2f3d38-faaa-40e2-a096-ffbebb5e4786 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Flavor limits 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:12:23.083203 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-0d2f3d38-faaa-40e2-a096-ffbebb5e4786 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Image limits 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:12:23.083934 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-0d2f3d38-faaa-40e2-a096-ffbebb5e4786 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Flavor pref 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:12:23.084586 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-0d2f3d38-faaa-40e2-a096-ffbebb5e4786 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Image pref 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:12:23.085356 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-0d2f3d38-faaa-40e2-a096-ffbebb5e4786 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:12:23.117931 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0d2f3d38-faaa-40e2-a096-ffbebb5e4786 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:23.118926 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0d2f3d38-faaa-40e2-a096-ffbebb5e4786 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:23.122058 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0d2f3d38-faaa-40e2-a096-ffbebb5e4786 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:23.123858 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0d2f3d38-faaa-40e2-a096-ffbebb5e4786 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:23.135974 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0d2f3d38-faaa-40e2-a096-ffbebb5e4786 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:23.136544 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0d2f3d38-faaa-40e2-a096-ffbebb5e4786 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:23.258340 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-0d2f3d38-faaa-40e2-a096-ffbebb5e4786 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Getting quotas for project ba8782e8b0af4a2eb7335a0500716b52. Resources: {'instances', 'cores', 'ram'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:12:23.270544 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-0d2f3d38-faaa-40e2-a096-ffbebb5e4786 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Getting quotas for user b4869c70eac84fddb30090585bc1f0de and project ba8782e8b0af4a2eb7335a0500716b52. Resources: {'instances', 'cores', 'ram'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:12:23.321477 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-0d2f3d38-faaa-40e2-a096-ffbebb5e4786 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Going to run 1 instances... {{(pid=120624) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:12:23.326685 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-0d2f3d38-faaa-40e2-a096-ffbebb5e4786 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f4f2ae76-bacc-4449-881b-f697e1eeec66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120624) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:12:23.491080 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-0d2f3d38-faaa-40e2-a096-ffbebb5e4786 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.787638 Aug 31 19:12:23.500364 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 14/21] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 31 19:12:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 3798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 19:12:23.507880 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-bb3a1d78-6b7b-457a-96d8-5bacce0d6104 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:23.511528 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-bb3a1d78-6b7b-457a-96d8-5bacce0d6104 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:23.525335 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bb3a1d78-6b7b-457a-96d8-5bacce0d6104 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:23.527700 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bb3a1d78-6b7b-457a-96d8-5bacce0d6104 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:23.528523 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bb3a1d78-6b7b-457a-96d8-5bacce0d6104 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:23.530247 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bb3a1d78-6b7b-457a-96d8-5bacce0d6104 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:23.531110 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bb3a1d78-6b7b-457a-96d8-5bacce0d6104 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:23.533858 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bb3a1d78-6b7b-457a-96d8-5bacce0d6104 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:23.878680 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-bb3a1d78-6b7b-457a-96d8-5bacce0d6104 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:23.906059 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-bb3a1d78-6b7b-457a-96d8-5bacce0d6104 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1274 microversion: 2.1 time: 0.404004 Aug 31 19:12:23.919656 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 15/22] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:23 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1274 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:23.939351 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-6eb4838d-d4c4-43b3-9bec-ae607d530a6d tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:23.939972 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-6eb4838d-d4c4-43b3-9bec-ae607d530a6d tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:24.030183 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-cd57cda3-0e2c-4412-9c51-753272057686 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Flavor limits 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:12:24.031385 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-cd57cda3-0e2c-4412-9c51-753272057686 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Image limits 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:12:24.032030 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-cd57cda3-0e2c-4412-9c51-753272057686 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Flavor pref 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:12:24.032597 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-cd57cda3-0e2c-4412-9c51-753272057686 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Image pref 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:12:24.033178 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-cd57cda3-0e2c-4412-9c51-753272057686 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:12:24.048698 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cd57cda3-0e2c-4412-9c51-753272057686 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:24.049392 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cd57cda3-0e2c-4412-9c51-753272057686 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:24.050006 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cd57cda3-0e2c-4412-9c51-753272057686 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:24.052558 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cd57cda3-0e2c-4412-9c51-753272057686 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:24.053250 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cd57cda3-0e2c-4412-9c51-753272057686 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:24.053863 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cd57cda3-0e2c-4412-9c51-753272057686 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:24.083063 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.quota [None req-cd57cda3-0e2c-4412-9c51-753272057686 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Getting quotas for project e6d782400f1e432c8d10a31334c42e68. Resources: {'instances', 'cores', 'ram'} {{(pid=120623) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:12:24.105661 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.quota [None req-cd57cda3-0e2c-4412-9c51-753272057686 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Getting quotas for user 0bfa1533b0944bd681f4c2a33cf701b0 and project e6d782400f1e432c8d10a31334c42e68. Resources: {'instances', 'cores', 'ram'} {{(pid=120623) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:12:24.130188 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-cd57cda3-0e2c-4412-9c51-753272057686 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Going to run 1 instances... {{(pid=120623) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:12:24.139780 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-cd57cda3-0e2c-4412-9c51-753272057686 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f4f2ae76-bacc-4449-881b-f697e1eeec66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120623) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:12:24.246721 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-cd57cda3-0e2c-4412-9c51-753272057686 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.598812 Aug 31 19:12:24.247953 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 8/23] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 31 19:12:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 1601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 19:12:24.262326 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-ce5e8338-a586-4e30-93ca-86ecdc7d428e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:24.263280 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-ce5e8338-a586-4e30-93ca-86ecdc7d428e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:24.358762 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-ce5e8338-a586-4e30-93ca-86ecdc7d428e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:24.371006 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-ce5e8338-a586-4e30-93ca-86ecdc7d428e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1241 microversion: 2.1 time: 0.115233 Aug 31 19:12:24.375251 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 9/24] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:24 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1241 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:24.671909 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-6eb4838d-d4c4-43b3-9bec-ae607d530a6d tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:24.681985 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-6eb4838d-d4c4-43b3-9bec-ae607d530a6d tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1214 microversion: 2.1 time: 0.764606 Aug 31 19:12:24.683005 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 16/25] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:23 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1214 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:24.928493 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-72e95bf5-5e7a-45a3-979e-ac28d053a226 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:24.930043 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-72e95bf5-5e7a-45a3-979e-ac28d053a226 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:24.945228 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-72e95bf5-5e7a-45a3-979e-ac28d053a226 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:24.948142 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-72e95bf5-5e7a-45a3-979e-ac28d053a226 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:24.950445 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-72e95bf5-5e7a-45a3-979e-ac28d053a226 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:24.952626 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-72e95bf5-5e7a-45a3-979e-ac28d053a226 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:24.955229 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-72e95bf5-5e7a-45a3-979e-ac28d053a226 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:24.958703 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-72e95bf5-5e7a-45a3-979e-ac28d053a226 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:25.395834 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-36ec2588-4e66-461a-88f4-334cade7a054 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:25.397468 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-36ec2588-4e66-461a-88f4-334cade7a054 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:25.430927 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-36ec2588-4e66-461a-88f4-334cade7a054 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:25.432989 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-36ec2588-4e66-461a-88f4-334cade7a054 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:25.435966 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-36ec2588-4e66-461a-88f4-334cade7a054 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:25.442367 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-36ec2588-4e66-461a-88f4-334cade7a054 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:25.449128 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-36ec2588-4e66-461a-88f4-334cade7a054 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:25.453642 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-36ec2588-4e66-461a-88f4-334cade7a054 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:25.792899 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-36ec2588-4e66-461a-88f4-334cade7a054 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:25.810742 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-36ec2588-4e66-461a-88f4-334cade7a054 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1245 microversion: 2.1 time: 0.414936 Aug 31 19:12:25.815276 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 17/26] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:25 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1245 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:25.828754 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-ebccb4eb-86f3-465f-ad9d-7781848b2baf tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:25.829322 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-ebccb4eb-86f3-465f-ad9d-7781848b2baf tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:25.852725 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-72e95bf5-5e7a-45a3-979e-ac28d053a226 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:25.885466 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ebccb4eb-86f3-465f-ad9d-7781848b2baf tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:25.895115 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ebccb4eb-86f3-465f-ad9d-7781848b2baf tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:25.896142 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ebccb4eb-86f3-465f-ad9d-7781848b2baf tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:25.897733 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ebccb4eb-86f3-465f-ad9d-7781848b2baf tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:25.901923 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ebccb4eb-86f3-465f-ad9d-7781848b2baf tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:25.903742 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ebccb4eb-86f3-465f-ad9d-7781848b2baf tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:25.921840 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-72e95bf5-5e7a-45a3-979e-ac28d053a226 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1280 microversion: 2.1 time: 0.997566 Aug 31 19:12:25.922499 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 10/27] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:24 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1280 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:26.836567 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-18efbed0-36a3-4f9c-9595-b253993350e3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:26.837477 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-18efbed0-36a3-4f9c-9595-b253993350e3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:26.848460 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-18efbed0-36a3-4f9c-9595-b253993350e3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:26.850974 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-18efbed0-36a3-4f9c-9595-b253993350e3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:26.852999 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-18efbed0-36a3-4f9c-9595-b253993350e3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:26.854564 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-18efbed0-36a3-4f9c-9595-b253993350e3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:26.856408 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-18efbed0-36a3-4f9c-9595-b253993350e3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:26.858163 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-18efbed0-36a3-4f9c-9595-b253993350e3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:27.018470 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-ebccb4eb-86f3-465f-ad9d-7781848b2baf tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:27.031145 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-ebccb4eb-86f3-465f-ad9d-7781848b2baf tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1266 microversion: 2.1 time: 1.214706 Aug 31 19:12:27.033875 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 18/28] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:25 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1266 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:27.047759 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-b530bff2-c708-48a0-a14f-1a041e08bba5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:27.050963 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-b530bff2-c708-48a0-a14f-1a041e08bba5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:27.068035 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b530bff2-c708-48a0-a14f-1a041e08bba5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:27.068954 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b530bff2-c708-48a0-a14f-1a041e08bba5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:27.070897 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b530bff2-c708-48a0-a14f-1a041e08bba5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:27.074248 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b530bff2-c708-48a0-a14f-1a041e08bba5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:27.076426 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b530bff2-c708-48a0-a14f-1a041e08bba5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:27.077095 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b530bff2-c708-48a0-a14f-1a041e08bba5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:27.535115 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-b530bff2-c708-48a0-a14f-1a041e08bba5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:27.551649 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-b530bff2-c708-48a0-a14f-1a041e08bba5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1280 microversion: 2.1 time: 0.513448 Aug 31 19:12:27.553045 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 19/29] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:27 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1280 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:28.061099 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-de5c976a-1c32-47b6-91f2-8c16975cb5dc tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:28.062623 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-de5c976a-1c32-47b6-91f2-8c16975cb5dc tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:28.075786 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-de5c976a-1c32-47b6-91f2-8c16975cb5dc tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:28.078292 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-de5c976a-1c32-47b6-91f2-8c16975cb5dc tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:28.080925 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-de5c976a-1c32-47b6-91f2-8c16975cb5dc tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:28.083968 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-de5c976a-1c32-47b6-91f2-8c16975cb5dc tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:28.084755 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-de5c976a-1c32-47b6-91f2-8c16975cb5dc tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:28.086661 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-de5c976a-1c32-47b6-91f2-8c16975cb5dc tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:28.319492 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-de5c976a-1c32-47b6-91f2-8c16975cb5dc tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:28.334937 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-de5c976a-1c32-47b6-91f2-8c16975cb5dc tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1272 microversion: 2.1 time: 0.279708 Aug 31 19:12:28.367226 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-18efbed0-36a3-4f9c-9595-b253993350e3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:28.372667 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 20/30] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:28 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1272 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:28.378123 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-18efbed0-36a3-4f9c-9595-b253993350e3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1293 microversion: 2.1 time: 1.547372 Aug 31 19:12:28.393241 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 11/31] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:26 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1293 bytes in 1549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:12:28.578532 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-658fc0f5-7ce1-460f-b836-2af18f59aaa5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:28.579284 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-658fc0f5-7ce1-460f-b836-2af18f59aaa5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:28.597530 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-658fc0f5-7ce1-460f-b836-2af18f59aaa5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:28.598580 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-658fc0f5-7ce1-460f-b836-2af18f59aaa5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:28.600888 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-658fc0f5-7ce1-460f-b836-2af18f59aaa5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:28.604772 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-658fc0f5-7ce1-460f-b836-2af18f59aaa5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:28.615145 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-658fc0f5-7ce1-460f-b836-2af18f59aaa5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:28.615756 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-658fc0f5-7ce1-460f-b836-2af18f59aaa5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:28.814572 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-658fc0f5-7ce1-460f-b836-2af18f59aaa5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:28.848954 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-658fc0f5-7ce1-460f-b836-2af18f59aaa5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1280 microversion: 2.1 time: 0.276669 Aug 31 19:12:28.850192 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 21/32] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:28 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1280 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:29.380194 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-4ad5976d-b07e-41c1-a6f3-675c9d526cd8 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:29.380811 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-4ad5976d-b07e-41c1-a6f3-675c9d526cd8 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:29.391021 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4ad5976d-b07e-41c1-a6f3-675c9d526cd8 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:29.391746 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4ad5976d-b07e-41c1-a6f3-675c9d526cd8 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:29.391937 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4ad5976d-b07e-41c1-a6f3-675c9d526cd8 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:29.398296 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4ad5976d-b07e-41c1-a6f3-675c9d526cd8 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:29.398765 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4ad5976d-b07e-41c1-a6f3-675c9d526cd8 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:29.399204 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4ad5976d-b07e-41c1-a6f3-675c9d526cd8 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:29.402715 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-f8bfd802-60ed-4ed6-a57e-417b96b4ecdc tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:29.403926 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-f8bfd802-60ed-4ed6-a57e-417b96b4ecdc tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:29.424110 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f8bfd802-60ed-4ed6-a57e-417b96b4ecdc tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:29.424896 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f8bfd802-60ed-4ed6-a57e-417b96b4ecdc tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:29.427741 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f8bfd802-60ed-4ed6-a57e-417b96b4ecdc tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:29.429114 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f8bfd802-60ed-4ed6-a57e-417b96b4ecdc tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:29.432272 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f8bfd802-60ed-4ed6-a57e-417b96b4ecdc tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:29.434919 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f8bfd802-60ed-4ed6-a57e-417b96b4ecdc tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:30.212219 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-f8bfd802-60ed-4ed6-a57e-417b96b4ecdc tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:30.223788 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-f8bfd802-60ed-4ed6-a57e-417b96b4ecdc tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1299 microversion: 2.1 time: 0.825604 Aug 31 19:12:30.242633 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 22/33] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:29 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1299 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:30.252998 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-60e5d51c-d144-4102-9f73-ea51fdc2a0ec tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:30.268253 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-60e5d51c-d144-4102-9f73-ea51fdc2a0ec tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:30.295300 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-60e5d51c-d144-4102-9f73-ea51fdc2a0ec tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:30.297894 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-60e5d51c-d144-4102-9f73-ea51fdc2a0ec tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:30.298675 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-60e5d51c-d144-4102-9f73-ea51fdc2a0ec tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:30.301453 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-60e5d51c-d144-4102-9f73-ea51fdc2a0ec tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:30.302952 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-60e5d51c-d144-4102-9f73-ea51fdc2a0ec tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:30.304050 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-60e5d51c-d144-4102-9f73-ea51fdc2a0ec tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:30.769557 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-4ad5976d-b07e-41c1-a6f3-675c9d526cd8 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:30.780241 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-4ad5976d-b07e-41c1-a6f3-675c9d526cd8 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1272 microversion: 2.1 time: 1.402353 Aug 31 19:12:30.783897 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 12/34] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:29 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1272 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:31.211661 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-60e5d51c-d144-4102-9f73-ea51fdc2a0ec tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:31.227106 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-60e5d51c-d144-4102-9f73-ea51fdc2a0ec tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1322 microversion: 2.1 time: 0.978556 Aug 31 19:12:31.227805 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 23/35] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:30 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1322 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:31.247124 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-fdbbda7e-f5ac-41a0-a600-adb8fdb2264c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:31.247851 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-fdbbda7e-f5ac-41a0-a600-adb8fdb2264c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:31.269861 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fdbbda7e-f5ac-41a0-a600-adb8fdb2264c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:31.270390 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fdbbda7e-f5ac-41a0-a600-adb8fdb2264c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:31.270838 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fdbbda7e-f5ac-41a0-a600-adb8fdb2264c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:31.271581 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fdbbda7e-f5ac-41a0-a600-adb8fdb2264c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:31.272038 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fdbbda7e-f5ac-41a0-a600-adb8fdb2264c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:31.272458 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fdbbda7e-f5ac-41a0-a600-adb8fdb2264c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:31.820816 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-4738e589-a5ac-4641-8f6f-b4329ded93d7 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:31.822474 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-4738e589-a5ac-4641-8f6f-b4329ded93d7 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:31.845960 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4738e589-a5ac-4641-8f6f-b4329ded93d7 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:31.848766 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4738e589-a5ac-4641-8f6f-b4329ded93d7 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:31.852021 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4738e589-a5ac-4641-8f6f-b4329ded93d7 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:31.856082 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4738e589-a5ac-4641-8f6f-b4329ded93d7 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:31.861276 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4738e589-a5ac-4641-8f6f-b4329ded93d7 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:31.861955 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4738e589-a5ac-4641-8f6f-b4329ded93d7 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:32.163429 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-4738e589-a5ac-4641-8f6f-b4329ded93d7 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:32.198238 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-4738e589-a5ac-4641-8f6f-b4329ded93d7 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1272 microversion: 2.1 time: 0.388762 Aug 31 19:12:32.201247 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 24/36] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:31 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1272 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:32.270069 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-624b035e-ffee-4875-8130-1a6d190a1251 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:32.271305 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-624b035e-ffee-4875-8130-1a6d190a1251 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:32.303921 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-624b035e-ffee-4875-8130-1a6d190a1251 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:32.304422 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-624b035e-ffee-4875-8130-1a6d190a1251 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:32.304855 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-624b035e-ffee-4875-8130-1a6d190a1251 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:32.315179 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-624b035e-ffee-4875-8130-1a6d190a1251 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:32.317015 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-624b035e-ffee-4875-8130-1a6d190a1251 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:32.318445 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-624b035e-ffee-4875-8130-1a6d190a1251 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:32.705840 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-624b035e-ffee-4875-8130-1a6d190a1251 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:32.715255 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-624b035e-ffee-4875-8130-1a6d190a1251 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1322 microversion: 2.1 time: 0.469398 Aug 31 19:12:32.718877 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 25/37] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:32 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1322 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:33.045849 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-fdbbda7e-f5ac-41a0-a600-adb8fdb2264c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:33.078768 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-fdbbda7e-f5ac-41a0-a600-adb8fdb2264c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1367 microversion: 2.1 time: 1.833538 Aug 31 19:12:33.082159 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 13/38] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:31 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1367 bytes in 1840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:33.223795 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-f96a793c-69df-4c82-a3a3-05969e26d89e tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:33.224420 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-f96a793c-69df-4c82-a3a3-05969e26d89e tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:33.242312 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell0:SELECT=2 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:33.243991 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f96a793c-69df-4c82-a3a3-05969e26d89e tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:33.244602 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f96a793c-69df-4c82-a3a3-05969e26d89e tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:33.245282 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f96a793c-69df-4c82-a3a3-05969e26d89e tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:33.246007 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f96a793c-69df-4c82-a3a3-05969e26d89e tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:33.246470 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f96a793c-69df-4c82-a3a3-05969e26d89e tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:33.246899 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f96a793c-69df-4c82-a3a3-05969e26d89e tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:33.574138 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-f96a793c-69df-4c82-a3a3-05969e26d89e tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:33.582256 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-f96a793c-69df-4c82-a3a3-05969e26d89e tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1314 microversion: 2.1 time: 0.362248 Aug 31 19:12:33.583468 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 26/39] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:33 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1314 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:33.739943 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-1caa721d-c509-4ab3-836c-46a3078713db tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:33.740869 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-1caa721d-c509-4ab3-836c-46a3078713db tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:33.750670 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1caa721d-c509-4ab3-836c-46a3078713db tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:33.751139 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1caa721d-c509-4ab3-836c-46a3078713db tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:33.751635 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1caa721d-c509-4ab3-836c-46a3078713db tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:33.752407 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1caa721d-c509-4ab3-836c-46a3078713db tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:33.756330 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1caa721d-c509-4ab3-836c-46a3078713db tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:33.757682 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1caa721d-c509-4ab3-836c-46a3078713db tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:33.949232 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1caa721d-c509-4ab3-836c-46a3078713db tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:33.957639 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-1caa721d-c509-4ab3-836c-46a3078713db tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1322 microversion: 2.1 time: 0.222236 Aug 31 19:12:33.960328 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 14/40] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:33 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:34.104049 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-083408c0-098e-4063-afee-3e4d0b0cbeb0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:34.105630 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-083408c0-098e-4063-afee-3e4d0b0cbeb0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:34.108842 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell0:SELECT=6 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:34.122133 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-39691e7a-7e9c-48ca-bbfc-30ed5b81c893 req-54a4a736-876e-4e34-8811-eb7a56480a8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28005e59-28f2-4e1e-a7d0-4ef68d9d6f48", "tag": "557704c0-c724-41a1-ae68-ae0c2d6b6bfd"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:12:34.137109 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-083408c0-098e-4063-afee-3e4d0b0cbeb0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:34.142930 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-083408c0-098e-4063-afee-3e4d0b0cbeb0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:34.143548 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-083408c0-098e-4063-afee-3e4d0b0cbeb0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:34.146443 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-083408c0-098e-4063-afee-3e4d0b0cbeb0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:34.147071 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-083408c0-098e-4063-afee-3e4d0b0cbeb0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:34.148444 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-083408c0-098e-4063-afee-3e4d0b0cbeb0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:34.158993 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-39691e7a-7e9c-48ca-bbfc-30ed5b81c893 req-54a4a736-876e-4e34-8811-eb7a56480a8f service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:34.171515 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-39691e7a-7e9c-48ca-bbfc-30ed5b81c893 req-54a4a736-876e-4e34-8811-eb7a56480a8f service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:34.173085 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-39691e7a-7e9c-48ca-bbfc-30ed5b81c893 req-54a4a736-876e-4e34-8811-eb7a56480a8f service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:34.230736 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-39691e7a-7e9c-48ca-bbfc-30ed5b81c893 req-54a4a736-876e-4e34-8811-eb7a56480a8f service nova] Creating event network-changed:557704c0-c724-41a1-ae68-ae0c2d6b6bfd for instance 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 on hv-cinder-83538 Aug 31 19:12:34.231271 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-39691e7a-7e9c-48ca-bbfc-30ed5b81c893 req-54a4a736-876e-4e34-8811-eb7a56480a8f service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120624) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 19:12:34.231663 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-39691e7a-7e9c-48ca-bbfc-30ed5b81c893 req-54a4a736-876e-4e34-8811-eb7a56480a8f service nova] Acquired lock "compute-rpcapi-router" {{(pid=120624) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 19:12:34.232719 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-59f496a6-1aa1-4105-aa03-2a3bafeab35e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:34.233172 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-59f496a6-1aa1-4105-aa03-2a3bafeab35e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:34.236021 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-59f496a6-1aa1-4105-aa03-2a3bafeab35e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:34.240219 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-59f496a6-1aa1-4105-aa03-2a3bafeab35e None None] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:34.241001 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-59f496a6-1aa1-4105-aa03-2a3bafeab35e None None] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:34.241704 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-59f496a6-1aa1-4105-aa03-2a3bafeab35e None None] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:34.265859 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.compute.rpcapi [None req-59f496a6-1aa1-4105-aa03-2a3bafeab35e None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 31 19:12:34.278263 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-59f496a6-1aa1-4105-aa03-2a3bafeab35e None None] Releasing lock "compute-rpcapi-router" {{(pid=120624) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 19:12:34.307188 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-59f496a6-1aa1-4105-aa03-2a3bafeab35e None None] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.392624 Aug 31 19:12:34.308816 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 27/41] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:12:34.364220 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell0:SELECT=24 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:34.399529 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-083408c0-098e-4063-afee-3e4d0b0cbeb0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:34.411698 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-083408c0-098e-4063-afee-3e4d0b0cbeb0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1367 microversion: 2.1 time: 0.311853 Aug 31 19:12:34.413055 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 15/42] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:34 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1367 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:12:34.607305 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-f3881ab1-c1cb-464f-b870-287e44fb16bb tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:34.609595 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-f3881ab1-c1cb-464f-b870-287e44fb16bb tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:34.616519 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f3881ab1-c1cb-464f-b870-287e44fb16bb tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:34.617029 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f3881ab1-c1cb-464f-b870-287e44fb16bb tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:34.617487 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f3881ab1-c1cb-464f-b870-287e44fb16bb tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:34.618291 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f3881ab1-c1cb-464f-b870-287e44fb16bb tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:34.618746 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f3881ab1-c1cb-464f-b870-287e44fb16bb tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:34.619206 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f3881ab1-c1cb-464f-b870-287e44fb16bb tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:34.680349 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell0:SELECT=14 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:34.783313 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-f3881ab1-c1cb-464f-b870-287e44fb16bb tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:34.793747 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-f3881ab1-c1cb-464f-b870-287e44fb16bb tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1314 microversion: 2.1 time: 0.193404 Aug 31 19:12:34.797373 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 28/43] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:34 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:34.983805 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-5a5680d2-8ba1-46b2-9b5e-4ddfed96f345 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:34.984617 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-5a5680d2-8ba1-46b2-9b5e-4ddfed96f345 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:34.993212 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5a5680d2-8ba1-46b2-9b5e-4ddfed96f345 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:34.993733 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5a5680d2-8ba1-46b2-9b5e-4ddfed96f345 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:34.994842 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5a5680d2-8ba1-46b2-9b5e-4ddfed96f345 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:34.996094 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5a5680d2-8ba1-46b2-9b5e-4ddfed96f345 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:34.996858 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5a5680d2-8ba1-46b2-9b5e-4ddfed96f345 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:34.997319 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5a5680d2-8ba1-46b2-9b5e-4ddfed96f345 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:35.395689 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-5a5680d2-8ba1-46b2-9b5e-4ddfed96f345 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:35.408448 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-5a5680d2-8ba1-46b2-9b5e-4ddfed96f345 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1322 microversion: 2.1 time: 0.429750 Aug 31 19:12:35.409256 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 16/44] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:34 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1322 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:35.434256 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-81e37cbc-25c5-4c84-a784-f6e04a293f48 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:35.434890 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-81e37cbc-25c5-4c84-a784-f6e04a293f48 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:35.453939 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-81e37cbc-25c5-4c84-a784-f6e04a293f48 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:35.454495 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-81e37cbc-25c5-4c84-a784-f6e04a293f48 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:35.454938 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-81e37cbc-25c5-4c84-a784-f6e04a293f48 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:35.457328 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-81e37cbc-25c5-4c84-a784-f6e04a293f48 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:35.459042 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-81e37cbc-25c5-4c84-a784-f6e04a293f48 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:35.459924 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-81e37cbc-25c5-4c84-a784-f6e04a293f48 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:35.736489 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-81e37cbc-25c5-4c84-a784-f6e04a293f48 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:35.750261 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-81e37cbc-25c5-4c84-a784-f6e04a293f48 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1367 microversion: 2.1 time: 0.320358 Aug 31 19:12:35.751295 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 29/45] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:35 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1367 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:35.815670 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-652066d2-284c-4725-8a98-672dad8d1014 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:35.816407 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-652066d2-284c-4725-8a98-672dad8d1014 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:35.824132 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-652066d2-284c-4725-8a98-672dad8d1014 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:35.824620 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-652066d2-284c-4725-8a98-672dad8d1014 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:35.825052 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-652066d2-284c-4725-8a98-672dad8d1014 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:35.831722 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-652066d2-284c-4725-8a98-672dad8d1014 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:35.834891 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-652066d2-284c-4725-8a98-672dad8d1014 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:35.835890 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-652066d2-284c-4725-8a98-672dad8d1014 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:36.088093 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-652066d2-284c-4725-8a98-672dad8d1014 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:36.098568 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-652066d2-284c-4725-8a98-672dad8d1014 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1314 microversion: 2.1 time: 0.286463 Aug 31 19:12:36.109763 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 17/46] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:35 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:36.342748 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-5f4fc70a-6a77-46be-b6f4-8218534a840a req-b3c9f4b1-fa46-4be8-b578-ff739ca6e63c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88b9d0d7-01c7-4a08-9a15-a20bd1db6019", "tag": "1822743f-00a6-44c7-b33e-1c7130689b42"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:12:36.353704 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-5f4fc70a-6a77-46be-b6f4-8218534a840a req-b3c9f4b1-fa46-4be8-b578-ff739ca6e63c service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:36.354438 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-5f4fc70a-6a77-46be-b6f4-8218534a840a req-b3c9f4b1-fa46-4be8-b578-ff739ca6e63c service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:36.354863 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-5f4fc70a-6a77-46be-b6f4-8218534a840a req-b3c9f4b1-fa46-4be8-b578-ff739ca6e63c service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:36.370206 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-5f4fc70a-6a77-46be-b6f4-8218534a840a req-b3c9f4b1-fa46-4be8-b578-ff739ca6e63c service nova] Creating event network-changed:1822743f-00a6-44c7-b33e-1c7130689b42 for instance 88b9d0d7-01c7-4a08-9a15-a20bd1db6019 on hv-cinder-83538 Aug 31 19:12:36.377881 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-5f4fc70a-6a77-46be-b6f4-8218534a840a req-b3c9f4b1-fa46-4be8-b578-ff739ca6e63c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038049 Aug 31 19:12:36.379274 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 30/47] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:12:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:12:36.452918 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d0806094-4292-4d86-9cc8-57d38f10e81c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:36.454315 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d0806094-4292-4d86-9cc8-57d38f10e81c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:36.463518 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d0806094-4292-4d86-9cc8-57d38f10e81c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:36.464042 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d0806094-4292-4d86-9cc8-57d38f10e81c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:36.464609 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d0806094-4292-4d86-9cc8-57d38f10e81c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:36.465801 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d0806094-4292-4d86-9cc8-57d38f10e81c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:36.466327 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d0806094-4292-4d86-9cc8-57d38f10e81c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:36.466835 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d0806094-4292-4d86-9cc8-57d38f10e81c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:36.607992 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-d0806094-4292-4d86-9cc8-57d38f10e81c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:36.616648 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-d0806094-4292-4d86-9cc8-57d38f10e81c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1322 microversion: 2.1 time: 0.183920 Aug 31 19:12:36.617599 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 18/48] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:36 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:36.775765 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-f562bb48-e3bb-4f7a-bac2-5d79ec4369b3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:36.776596 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-f562bb48-e3bb-4f7a-bac2-5d79ec4369b3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:36.784675 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f562bb48-e3bb-4f7a-bac2-5d79ec4369b3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:36.785159 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f562bb48-e3bb-4f7a-bac2-5d79ec4369b3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:36.785827 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f562bb48-e3bb-4f7a-bac2-5d79ec4369b3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:36.786483 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f562bb48-e3bb-4f7a-bac2-5d79ec4369b3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:36.786844 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f562bb48-e3bb-4f7a-bac2-5d79ec4369b3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:36.787675 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f562bb48-e3bb-4f7a-bac2-5d79ec4369b3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:36.964318 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-f562bb48-e3bb-4f7a-bac2-5d79ec4369b3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:36.983050 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-f562bb48-e3bb-4f7a-bac2-5d79ec4369b3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1367 microversion: 2.1 time: 0.214254 Aug 31 19:12:36.983899 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 31/49] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:36 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:37.121716 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-dfad1f1d-29a4-43d0-9d40-7389d3fc04b8 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:37.122316 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-dfad1f1d-29a4-43d0-9d40-7389d3fc04b8 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:37.126298 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=9 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:37.129917 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-dfad1f1d-29a4-43d0-9d40-7389d3fc04b8 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:37.130403 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-dfad1f1d-29a4-43d0-9d40-7389d3fc04b8 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:37.131031 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-dfad1f1d-29a4-43d0-9d40-7389d3fc04b8 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:37.131721 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-dfad1f1d-29a4-43d0-9d40-7389d3fc04b8 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:37.132362 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-dfad1f1d-29a4-43d0-9d40-7389d3fc04b8 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:37.132941 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-dfad1f1d-29a4-43d0-9d40-7389d3fc04b8 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:37.316609 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-dfad1f1d-29a4-43d0-9d40-7389d3fc04b8 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:37.329422 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-dfad1f1d-29a4-43d0-9d40-7389d3fc04b8 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1314 microversion: 2.1 time: 0.212188 Aug 31 19:12:37.330519 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 19/50] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:37 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:37.640416 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-80bc3c3d-a803-4ca0-841c-077ac7e82525 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:37.641401 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-80bc3c3d-a803-4ca0-841c-077ac7e82525 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:37.652435 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-80bc3c3d-a803-4ca0-841c-077ac7e82525 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:37.652921 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-80bc3c3d-a803-4ca0-841c-077ac7e82525 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:37.653609 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-80bc3c3d-a803-4ca0-841c-077ac7e82525 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:37.654336 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-80bc3c3d-a803-4ca0-841c-077ac7e82525 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:37.654787 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-80bc3c3d-a803-4ca0-841c-077ac7e82525 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:37.655202 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-80bc3c3d-a803-4ca0-841c-077ac7e82525 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:37.803141 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-80bc3c3d-a803-4ca0-841c-077ac7e82525 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:37.812383 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-80bc3c3d-a803-4ca0-841c-077ac7e82525 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1322 microversion: 2.1 time: 0.177908 Aug 31 19:12:37.813551 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 32/51] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:37 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:38.007423 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-b5f18421-72b3-4c51-a026-4c595a352692 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:38.008770 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-b5f18421-72b3-4c51-a026-4c595a352692 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:38.019990 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b5f18421-72b3-4c51-a026-4c595a352692 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:38.020558 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b5f18421-72b3-4c51-a026-4c595a352692 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:38.022531 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b5f18421-72b3-4c51-a026-4c595a352692 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:38.023938 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b5f18421-72b3-4c51-a026-4c595a352692 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:38.025886 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b5f18421-72b3-4c51-a026-4c595a352692 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:38.026479 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b5f18421-72b3-4c51-a026-4c595a352692 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:38.370839 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-d173f855-ca08-487d-bd4c-39874b05bbd0 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:38.377753 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-d173f855-ca08-487d-bd4c-39874b05bbd0 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:38.394958 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d173f855-ca08-487d-bd4c-39874b05bbd0 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:38.397858 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d173f855-ca08-487d-bd4c-39874b05bbd0 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:38.398495 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d173f855-ca08-487d-bd4c-39874b05bbd0 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:38.399439 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d173f855-ca08-487d-bd4c-39874b05bbd0 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:38.401546 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d173f855-ca08-487d-bd4c-39874b05bbd0 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:38.402329 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d173f855-ca08-487d-bd4c-39874b05bbd0 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:38.454575 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=100 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:38.471216 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-b5f18421-72b3-4c51-a026-4c595a352692 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:38.480009 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-b5f18421-72b3-4c51-a026-4c595a352692 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1367 microversion: 2.1 time: 0.477009 Aug 31 19:12:38.481638 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 20/52] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:38 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1367 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:38.707813 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-d173f855-ca08-487d-bd4c-39874b05bbd0 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:38.716869 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-d173f855-ca08-487d-bd4c-39874b05bbd0 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1314 microversion: 2.1 time: 0.368660 Aug 31 19:12:38.726404 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 33/53] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:38 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:38.833636 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-0c0c355f-b02e-4ba7-8d5a-7ff1bb75d34a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:38.834368 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-0c0c355f-b02e-4ba7-8d5a-7ff1bb75d34a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:38.843988 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0c0c355f-b02e-4ba7-8d5a-7ff1bb75d34a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:38.844947 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0c0c355f-b02e-4ba7-8d5a-7ff1bb75d34a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:38.845640 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0c0c355f-b02e-4ba7-8d5a-7ff1bb75d34a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:38.846901 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0c0c355f-b02e-4ba7-8d5a-7ff1bb75d34a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:38.847565 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0c0c355f-b02e-4ba7-8d5a-7ff1bb75d34a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:38.848557 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0c0c355f-b02e-4ba7-8d5a-7ff1bb75d34a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:39.138787 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-0c0c355f-b02e-4ba7-8d5a-7ff1bb75d34a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:39.152038 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-0c0c355f-b02e-4ba7-8d5a-7ff1bb75d34a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1322 microversion: 2.1 time: 0.323069 Aug 31 19:12:39.155347 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 21/54] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:38 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1322 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:39.503859 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-ce154d1a-4306-4b68-894d-8762c1245f9c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:39.504510 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-ce154d1a-4306-4b68-894d-8762c1245f9c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:39.516632 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ce154d1a-4306-4b68-894d-8762c1245f9c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:39.517290 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ce154d1a-4306-4b68-894d-8762c1245f9c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:39.517908 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ce154d1a-4306-4b68-894d-8762c1245f9c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:39.524086 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ce154d1a-4306-4b68-894d-8762c1245f9c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:39.524646 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ce154d1a-4306-4b68-894d-8762c1245f9c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:39.527905 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ce154d1a-4306-4b68-894d-8762c1245f9c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:39.740143 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-fb1c861b-9215-4a26-b617-e54919291612 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:39.740911 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-fb1c861b-9215-4a26-b617-e54919291612 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:39.756982 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fb1c861b-9215-4a26-b617-e54919291612 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:39.758714 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fb1c861b-9215-4a26-b617-e54919291612 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:39.760020 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fb1c861b-9215-4a26-b617-e54919291612 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:39.761224 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fb1c861b-9215-4a26-b617-e54919291612 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:39.762655 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fb1c861b-9215-4a26-b617-e54919291612 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:39.763640 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fb1c861b-9215-4a26-b617-e54919291612 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:39.896302 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-ce154d1a-4306-4b68-894d-8762c1245f9c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:39.927036 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-ce154d1a-4306-4b68-894d-8762c1245f9c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1367 microversion: 2.1 time: 0.427794 Aug 31 19:12:39.934008 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 34/55] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:39 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1367 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:40.035321 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-fb1c861b-9215-4a26-b617-e54919291612 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:40.045688 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-fb1c861b-9215-4a26-b617-e54919291612 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1314 microversion: 2.1 time: 0.309715 Aug 31 19:12:40.046764 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 22/56] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:39 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:40.176216 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-1f7a920b-9dc0-4152-a44d-11f04709deb2 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:40.176826 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-1f7a920b-9dc0-4152-a44d-11f04709deb2 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:40.187381 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1f7a920b-9dc0-4152-a44d-11f04709deb2 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:40.188219 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1f7a920b-9dc0-4152-a44d-11f04709deb2 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:40.188845 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1f7a920b-9dc0-4152-a44d-11f04709deb2 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:40.197627 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1f7a920b-9dc0-4152-a44d-11f04709deb2 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:40.198260 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1f7a920b-9dc0-4152-a44d-11f04709deb2 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:40.198700 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1f7a920b-9dc0-4152-a44d-11f04709deb2 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:40.392408 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-1f7a920b-9dc0-4152-a44d-11f04709deb2 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:40.405304 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-1f7a920b-9dc0-4152-a44d-11f04709deb2 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1322 microversion: 2.1 time: 0.233140 Aug 31 19:12:40.405961 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 35/57] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:40 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:40.955255 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-8b4c2833-4010-43b7-9fee-061f0a17fabf tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:40.956502 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-8b4c2833-4010-43b7-9fee-061f0a17fabf tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:40.963709 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8b4c2833-4010-43b7-9fee-061f0a17fabf tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:40.964354 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8b4c2833-4010-43b7-9fee-061f0a17fabf tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:40.964961 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8b4c2833-4010-43b7-9fee-061f0a17fabf tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:40.965821 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8b4c2833-4010-43b7-9fee-061f0a17fabf tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:40.966409 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8b4c2833-4010-43b7-9fee-061f0a17fabf tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:40.966824 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8b4c2833-4010-43b7-9fee-061f0a17fabf tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:41.068890 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-8dae27ae-2848-4908-bd4e-7ba333c22ab0 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:41.069629 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-8dae27ae-2848-4908-bd4e-7ba333c22ab0 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:41.076470 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8dae27ae-2848-4908-bd4e-7ba333c22ab0 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:41.077172 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8dae27ae-2848-4908-bd4e-7ba333c22ab0 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:41.077866 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8dae27ae-2848-4908-bd4e-7ba333c22ab0 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:41.079111 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8dae27ae-2848-4908-bd4e-7ba333c22ab0 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:41.079715 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8dae27ae-2848-4908-bd4e-7ba333c22ab0 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:41.080270 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8dae27ae-2848-4908-bd4e-7ba333c22ab0 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:41.111490 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-8b4c2833-4010-43b7-9fee-061f0a17fabf tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:41.121550 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-8b4c2833-4010-43b7-9fee-061f0a17fabf tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1367 microversion: 2.1 time: 0.169925 Aug 31 19:12:41.122119 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 23/58] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:40 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:41.265265 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-8dae27ae-2848-4908-bd4e-7ba333c22ab0 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:41.273491 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-8dae27ae-2848-4908-bd4e-7ba333c22ab0 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1314 microversion: 2.1 time: 0.208355 Aug 31 19:12:41.274062 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 36/59] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:41 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:41.425921 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-7d5872c5-6b20-4ec0-8696-e600d1a0951e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:41.426527 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-7d5872c5-6b20-4ec0-8696-e600d1a0951e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:41.432453 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7d5872c5-6b20-4ec0-8696-e600d1a0951e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:41.432975 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7d5872c5-6b20-4ec0-8696-e600d1a0951e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:41.433647 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7d5872c5-6b20-4ec0-8696-e600d1a0951e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:41.434503 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7d5872c5-6b20-4ec0-8696-e600d1a0951e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:41.435107 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7d5872c5-6b20-4ec0-8696-e600d1a0951e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:41.435564 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7d5872c5-6b20-4ec0-8696-e600d1a0951e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:41.597829 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-7d5872c5-6b20-4ec0-8696-e600d1a0951e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:41.609740 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-7d5872c5-6b20-4ec0-8696-e600d1a0951e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1322 microversion: 2.1 time: 0.186184 Aug 31 19:12:41.625159 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 24/60] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:41 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:42.142932 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-782faab6-1dce-4b7f-883a-c35d992c1249 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:42.143738 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-782faab6-1dce-4b7f-883a-c35d992c1249 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:42.149597 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-782faab6-1dce-4b7f-883a-c35d992c1249 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:42.150622 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-782faab6-1dce-4b7f-883a-c35d992c1249 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:42.151120 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-782faab6-1dce-4b7f-883a-c35d992c1249 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:42.152005 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-782faab6-1dce-4b7f-883a-c35d992c1249 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:42.152465 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-782faab6-1dce-4b7f-883a-c35d992c1249 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:42.153385 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-782faab6-1dce-4b7f-883a-c35d992c1249 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:42.296408 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d55908f4-13ad-4dd8-9b5f-4e9735367daf tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:42.297343 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d55908f4-13ad-4dd8-9b5f-4e9735367daf tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:42.306570 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d55908f4-13ad-4dd8-9b5f-4e9735367daf tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:42.306970 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d55908f4-13ad-4dd8-9b5f-4e9735367daf tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:42.307624 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d55908f4-13ad-4dd8-9b5f-4e9735367daf tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:42.308451 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d55908f4-13ad-4dd8-9b5f-4e9735367daf tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:42.309127 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d55908f4-13ad-4dd8-9b5f-4e9735367daf tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:42.309725 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d55908f4-13ad-4dd8-9b5f-4e9735367daf tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:42.331124 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-782faab6-1dce-4b7f-883a-c35d992c1249 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:42.338053 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=100 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:42.343453 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-782faab6-1dce-4b7f-883a-c35d992c1249 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1367 microversion: 2.1 time: 0.204280 Aug 31 19:12:42.345814 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 37/61] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:42 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1367 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:42.483441 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-d55908f4-13ad-4dd8-9b5f-4e9735367daf tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:42.491477 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-d55908f4-13ad-4dd8-9b5f-4e9735367daf tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1314 microversion: 2.1 time: 0.199117 Aug 31 19:12:42.492334 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 25/62] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:42 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:42.633063 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-8626768f-caa8-4589-9dba-b3b90aa32d91 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:42.635336 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-8626768f-caa8-4589-9dba-b3b90aa32d91 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:42.642365 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8626768f-caa8-4589-9dba-b3b90aa32d91 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:42.643328 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8626768f-caa8-4589-9dba-b3b90aa32d91 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:42.644159 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8626768f-caa8-4589-9dba-b3b90aa32d91 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:42.645019 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8626768f-caa8-4589-9dba-b3b90aa32d91 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:42.645937 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8626768f-caa8-4589-9dba-b3b90aa32d91 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:42.646507 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8626768f-caa8-4589-9dba-b3b90aa32d91 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:42.802556 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-8626768f-caa8-4589-9dba-b3b90aa32d91 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:42.814528 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-8626768f-caa8-4589-9dba-b3b90aa32d91 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1322 microversion: 2.1 time: 0.186249 Aug 31 19:12:42.815354 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 38/63] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:42 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:43.365961 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-2f4559a0-c3ff-489d-9d34-9984c4959f71 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:43.367656 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-2f4559a0-c3ff-489d-9d34-9984c4959f71 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:43.375093 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2f4559a0-c3ff-489d-9d34-9984c4959f71 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:43.375586 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2f4559a0-c3ff-489d-9d34-9984c4959f71 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:43.376017 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2f4559a0-c3ff-489d-9d34-9984c4959f71 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:43.376895 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2f4559a0-c3ff-489d-9d34-9984c4959f71 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:43.377521 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2f4559a0-c3ff-489d-9d34-9984c4959f71 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:43.377941 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2f4559a0-c3ff-489d-9d34-9984c4959f71 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:43.511875 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-71c3c19a-69f4-47fc-9f75-4467380c8f30 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:43.512526 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-71c3c19a-69f4-47fc-9f75-4467380c8f30 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:43.518579 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-71c3c19a-69f4-47fc-9f75-4467380c8f30 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:43.519138 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-71c3c19a-69f4-47fc-9f75-4467380c8f30 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:43.519606 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-71c3c19a-69f4-47fc-9f75-4467380c8f30 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:43.520298 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-71c3c19a-69f4-47fc-9f75-4467380c8f30 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:43.520749 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-71c3c19a-69f4-47fc-9f75-4467380c8f30 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:43.521168 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-71c3c19a-69f4-47fc-9f75-4467380c8f30 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:43.576171 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-2f4559a0-c3ff-489d-9d34-9984c4959f71 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:43.584101 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-2f4559a0-c3ff-489d-9d34-9984c4959f71 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1367 microversion: 2.1 time: 0.222180 Aug 31 19:12:43.584681 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 26/64] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:43 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1367 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:43.806894 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-71c3c19a-69f4-47fc-9f75-4467380c8f30 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:43.814360 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-71c3c19a-69f4-47fc-9f75-4467380c8f30 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1314 microversion: 2.1 time: 0.306270 Aug 31 19:12:43.814925 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 39/65] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:43 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:12:43.836157 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-1ba365df-b9e0-405a-ab81-7519f4f44271 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:43.836756 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-1ba365df-b9e0-405a-ab81-7519f4f44271 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:43.843886 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1ba365df-b9e0-405a-ab81-7519f4f44271 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:43.844372 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1ba365df-b9e0-405a-ab81-7519f4f44271 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:43.845286 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1ba365df-b9e0-405a-ab81-7519f4f44271 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:43.846214 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1ba365df-b9e0-405a-ab81-7519f4f44271 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:43.846668 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1ba365df-b9e0-405a-ab81-7519f4f44271 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:43.847080 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1ba365df-b9e0-405a-ab81-7519f4f44271 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:43.985367 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1ba365df-b9e0-405a-ab81-7519f4f44271 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:43.993112 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-1ba365df-b9e0-405a-ab81-7519f4f44271 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1322 microversion: 2.1 time: 0.161122 Aug 31 19:12:43.993864 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 27/66] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:43 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:44.605861 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-f776698c-a534-4388-8802-35d0d46e46f7 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:44.609773 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-f776698c-a534-4388-8802-35d0d46e46f7 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:44.625470 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell0:SELECT=2 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:44.630239 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f776698c-a534-4388-8802-35d0d46e46f7 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:44.631654 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f776698c-a534-4388-8802-35d0d46e46f7 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:44.632859 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f776698c-a534-4388-8802-35d0d46e46f7 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:44.636085 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f776698c-a534-4388-8802-35d0d46e46f7 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:44.638010 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f776698c-a534-4388-8802-35d0d46e46f7 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:44.638667 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f776698c-a534-4388-8802-35d0d46e46f7 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:44.835858 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d8cba1cf-32e6-4e4e-9297-7fcb31615014 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:44.836569 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d8cba1cf-32e6-4e4e-9297-7fcb31615014 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:44.848737 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d8cba1cf-32e6-4e4e-9297-7fcb31615014 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:44.849405 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d8cba1cf-32e6-4e4e-9297-7fcb31615014 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:44.851239 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d8cba1cf-32e6-4e4e-9297-7fcb31615014 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:44.852280 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d8cba1cf-32e6-4e4e-9297-7fcb31615014 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:44.853857 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d8cba1cf-32e6-4e4e-9297-7fcb31615014 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:44.855527 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d8cba1cf-32e6-4e4e-9297-7fcb31615014 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:44.917032 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-f776698c-a534-4388-8802-35d0d46e46f7 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:44.925221 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-f776698c-a534-4388-8802-35d0d46e46f7 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1367 microversion: 2.1 time: 0.323310 Aug 31 19:12:44.925792 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 40/67] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:44 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1367 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:45.014678 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-8b2e9367-3945-43a4-a24b-ab6f28b92199 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:45.015508 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-8b2e9367-3945-43a4-a24b-ab6f28b92199 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:45.017872 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=4 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:45.030342 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8b2e9367-3945-43a4-a24b-ab6f28b92199 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:45.030958 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8b2e9367-3945-43a4-a24b-ab6f28b92199 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:45.031492 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8b2e9367-3945-43a4-a24b-ab6f28b92199 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:45.034644 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8b2e9367-3945-43a4-a24b-ab6f28b92199 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:45.035208 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8b2e9367-3945-43a4-a24b-ab6f28b92199 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:45.038530 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8b2e9367-3945-43a4-a24b-ab6f28b92199 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:45.135525 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-d8cba1cf-32e6-4e4e-9297-7fcb31615014 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:45.157737 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-d8cba1cf-32e6-4e4e-9297-7fcb31615014 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1314 microversion: 2.1 time: 0.325897 Aug 31 19:12:45.175808 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 28/68] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:44 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:12:45.312585 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-8b2e9367-3945-43a4-a24b-ab6f28b92199 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:45.329299 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-8b2e9367-3945-43a4-a24b-ab6f28b92199 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1322 microversion: 2.1 time: 0.318371 Aug 31 19:12:45.329939 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 41/69] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:45 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1322 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:12:45.448342 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-0d004474-e367-4f0c-ba16-85709fdfeb22 req-bf94fd52-b3f7-4b46-8866-3bfdf6ee37e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb", "tag": "1adf99e2-adb2-4055-815e-64ce31792411"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:12:45.472397 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-0d004474-e367-4f0c-ba16-85709fdfeb22 req-bf94fd52-b3f7-4b46-8866-3bfdf6ee37e1 service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:45.472397 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-0d004474-e367-4f0c-ba16-85709fdfeb22 req-bf94fd52-b3f7-4b46-8866-3bfdf6ee37e1 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:45.472397 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-0d004474-e367-4f0c-ba16-85709fdfeb22 req-bf94fd52-b3f7-4b46-8866-3bfdf6ee37e1 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:45.490135 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-0d004474-e367-4f0c-ba16-85709fdfeb22 req-bf94fd52-b3f7-4b46-8866-3bfdf6ee37e1 service nova] Creating event network-changed:1adf99e2-adb2-4055-815e-64ce31792411 for instance e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb on hv-cinder-83538 Aug 31 19:12:45.490918 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-0d004474-e367-4f0c-ba16-85709fdfeb22 req-bf94fd52-b3f7-4b46-8866-3bfdf6ee37e1 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120623) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 19:12:45.491609 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-0d004474-e367-4f0c-ba16-85709fdfeb22 req-bf94fd52-b3f7-4b46-8866-3bfdf6ee37e1 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120623) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 19:12:45.492730 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f25ec8d1-09c5-409a-91f4-ac8349dc37ee None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:45.495203 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f25ec8d1-09c5-409a-91f4-ac8349dc37ee None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:45.495203 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f25ec8d1-09c5-409a-91f4-ac8349dc37ee None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:45.495203 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f25ec8d1-09c5-409a-91f4-ac8349dc37ee None None] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:45.495203 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f25ec8d1-09c5-409a-91f4-ac8349dc37ee None None] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:45.495558 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f25ec8d1-09c5-409a-91f4-ac8349dc37ee None None] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:45.507980 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.compute.rpcapi [None req-f25ec8d1-09c5-409a-91f4-ac8349dc37ee None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 31 19:12:45.511350 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f25ec8d1-09c5-409a-91f4-ac8349dc37ee None None] Releasing lock "compute-rpcapi-router" {{(pid=120623) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 19:12:45.538038 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-f25ec8d1-09c5-409a-91f4-ac8349dc37ee None None] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.295773 Aug 31 19:12:45.538715 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 29/70] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:12:45.952563 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-45266e79-3e77-47fe-a237-4b5e87ee6b68 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:45.953973 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-45266e79-3e77-47fe-a237-4b5e87ee6b68 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:45.960306 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-45266e79-3e77-47fe-a237-4b5e87ee6b68 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:45.960807 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-45266e79-3e77-47fe-a237-4b5e87ee6b68 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:45.961259 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-45266e79-3e77-47fe-a237-4b5e87ee6b68 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:45.962029 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-45266e79-3e77-47fe-a237-4b5e87ee6b68 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:45.962535 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-45266e79-3e77-47fe-a237-4b5e87ee6b68 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:45.963038 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-45266e79-3e77-47fe-a237-4b5e87ee6b68 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:46.110900 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-45266e79-3e77-47fe-a237-4b5e87ee6b68 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:46.119805 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-45266e79-3e77-47fe-a237-4b5e87ee6b68 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1367 microversion: 2.1 time: 0.174876 Aug 31 19:12:46.120840 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 42/71] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:45 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:46.182186 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-404bfa54-4c76-4674-8344-910557c53681 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:46.182919 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-404bfa54-4c76-4674-8344-910557c53681 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:46.189096 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-404bfa54-4c76-4674-8344-910557c53681 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:46.189609 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-404bfa54-4c76-4674-8344-910557c53681 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:46.195515 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-404bfa54-4c76-4674-8344-910557c53681 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:46.196287 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-404bfa54-4c76-4674-8344-910557c53681 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:46.196854 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-404bfa54-4c76-4674-8344-910557c53681 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:46.197379 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-404bfa54-4c76-4674-8344-910557c53681 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:46.343501 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-404bfa54-4c76-4674-8344-910557c53681 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:46.349459 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-360efca8-813e-4a6f-81e8-2e8be73eba82 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:46.350061 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-360efca8-813e-4a6f-81e8-2e8be73eba82 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:46.352188 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-404bfa54-4c76-4674-8344-910557c53681 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1314 microversion: 2.1 time: 0.174203 Aug 31 19:12:46.353538 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 30/72] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:46 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:46.357710 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-360efca8-813e-4a6f-81e8-2e8be73eba82 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:46.358135 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-360efca8-813e-4a6f-81e8-2e8be73eba82 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:46.358607 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-360efca8-813e-4a6f-81e8-2e8be73eba82 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:46.359475 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-360efca8-813e-4a6f-81e8-2e8be73eba82 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:46.359917 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-360efca8-813e-4a6f-81e8-2e8be73eba82 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:46.360325 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-360efca8-813e-4a6f-81e8-2e8be73eba82 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:46.499664 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-360efca8-813e-4a6f-81e8-2e8be73eba82 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:46.508179 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-360efca8-813e-4a6f-81e8-2e8be73eba82 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1322 microversion: 2.1 time: 0.162393 Aug 31 19:12:46.508746 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 43/73] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:46 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:12:47.140849 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-f40e126f-f056-4111-a824-6e03b5d16984 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:47.141502 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-f40e126f-f056-4111-a824-6e03b5d16984 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:47.147867 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f40e126f-f056-4111-a824-6e03b5d16984 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:47.148693 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f40e126f-f056-4111-a824-6e03b5d16984 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:47.149360 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f40e126f-f056-4111-a824-6e03b5d16984 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:47.150586 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f40e126f-f056-4111-a824-6e03b5d16984 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:47.151048 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f40e126f-f056-4111-a824-6e03b5d16984 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:47.151501 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f40e126f-f056-4111-a824-6e03b5d16984 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:47.375782 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-8c18f73d-cda6-40b7-99df-b228cebaa52e tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:47.376432 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-8c18f73d-cda6-40b7-99df-b228cebaa52e tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:47.382504 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8c18f73d-cda6-40b7-99df-b228cebaa52e tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:47.382982 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8c18f73d-cda6-40b7-99df-b228cebaa52e tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:47.383402 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8c18f73d-cda6-40b7-99df-b228cebaa52e tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:47.384588 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8c18f73d-cda6-40b7-99df-b228cebaa52e tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:47.385089 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8c18f73d-cda6-40b7-99df-b228cebaa52e tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:47.385565 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8c18f73d-cda6-40b7-99df-b228cebaa52e tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:47.409612 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-f40e126f-f056-4111-a824-6e03b5d16984 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:47.418766 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-f40e126f-f056-4111-a824-6e03b5d16984 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1367 microversion: 2.1 time: 0.281817 Aug 31 19:12:47.419634 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 31/74] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:47 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1367 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:47.530020 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-ef3c61eb-df29-4920-b615-d3b141a2f329 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:47.530481 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-ef3c61eb-df29-4920-b615-d3b141a2f329 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:47.542406 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-8c18f73d-cda6-40b7-99df-b228cebaa52e tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:47.548682 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ef3c61eb-df29-4920-b615-d3b141a2f329 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:47.556812 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ef3c61eb-df29-4920-b615-d3b141a2f329 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:47.557960 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ef3c61eb-df29-4920-b615-d3b141a2f329 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:47.558848 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ef3c61eb-df29-4920-b615-d3b141a2f329 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:47.559462 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ef3c61eb-df29-4920-b615-d3b141a2f329 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:47.560095 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ef3c61eb-df29-4920-b615-d3b141a2f329 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:47.585425 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-8c18f73d-cda6-40b7-99df-b228cebaa52e tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1314 microversion: 2.1 time: 0.212029 Aug 31 19:12:47.586524 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 44/75] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:47 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:12:48.137524 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-ef3c61eb-df29-4920-b615-d3b141a2f329 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:48.149732 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-ef3c61eb-df29-4920-b615-d3b141a2f329 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1322 microversion: 2.1 time: 0.623563 Aug 31 19:12:48.152495 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 32/76] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:47 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1322 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:12:48.440011 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-a32ab2d4-0ec7-4de5-8455-22e45ad755dc tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:48.441005 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-a32ab2d4-0ec7-4de5-8455-22e45ad755dc tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:48.452768 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a32ab2d4-0ec7-4de5-8455-22e45ad755dc tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:48.454103 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a32ab2d4-0ec7-4de5-8455-22e45ad755dc tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:48.455190 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a32ab2d4-0ec7-4de5-8455-22e45ad755dc tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:48.456552 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a32ab2d4-0ec7-4de5-8455-22e45ad755dc tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:48.458496 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a32ab2d4-0ec7-4de5-8455-22e45ad755dc tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:48.460366 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a32ab2d4-0ec7-4de5-8455-22e45ad755dc tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:48.609296 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-b712d31f-92ed-41b7-9f3a-9eb4df7f8527 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:48.610212 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-b712d31f-92ed-41b7-9f3a-9eb4df7f8527 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:48.620412 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b712d31f-92ed-41b7-9f3a-9eb4df7f8527 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:48.623443 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b712d31f-92ed-41b7-9f3a-9eb4df7f8527 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:48.624800 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b712d31f-92ed-41b7-9f3a-9eb4df7f8527 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:48.626558 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b712d31f-92ed-41b7-9f3a-9eb4df7f8527 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:48.627039 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b712d31f-92ed-41b7-9f3a-9eb4df7f8527 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:48.627470 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b712d31f-92ed-41b7-9f3a-9eb4df7f8527 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:48.870848 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-a32ab2d4-0ec7-4de5-8455-22e45ad755dc tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:48.892627 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-a32ab2d4-0ec7-4de5-8455-22e45ad755dc tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1367 microversion: 2.1 time: 0.456933 Aug 31 19:12:48.895619 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 45/77] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:48 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1367 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:49.042631 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-b712d31f-92ed-41b7-9f3a-9eb4df7f8527 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:49.053516 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-b712d31f-92ed-41b7-9f3a-9eb4df7f8527 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1314 microversion: 2.1 time: 0.448037 Aug 31 19:12:49.057226 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 33/78] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:48 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1314 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:49.169065 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-5cec152e-59bc-47aa-ab37-772ce32370c1 req-47884aa4-2ddc-40f2-8af1-7f6066114b7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9141c1ef-36d3-4d8c-bd46-8045891fe3c2", "tag": "54772a5e-157f-44ed-b49a-99e7be75af5e"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:12:49.175262 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d9d1483d-c4e0-4f89-980b-3fe6ab5d926b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:49.176158 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d9d1483d-c4e0-4f89-980b-3fe6ab5d926b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:49.191767 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d9d1483d-c4e0-4f89-980b-3fe6ab5d926b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:49.195019 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d9d1483d-c4e0-4f89-980b-3fe6ab5d926b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:49.201305 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d9d1483d-c4e0-4f89-980b-3fe6ab5d926b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:49.202200 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d9d1483d-c4e0-4f89-980b-3fe6ab5d926b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:49.203194 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d9d1483d-c4e0-4f89-980b-3fe6ab5d926b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:49.203636 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d9d1483d-c4e0-4f89-980b-3fe6ab5d926b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:49.207858 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-5cec152e-59bc-47aa-ab37-772ce32370c1 req-47884aa4-2ddc-40f2-8af1-7f6066114b7f service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:49.208572 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-5cec152e-59bc-47aa-ab37-772ce32370c1 req-47884aa4-2ddc-40f2-8af1-7f6066114b7f service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:49.209088 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-5cec152e-59bc-47aa-ab37-772ce32370c1 req-47884aa4-2ddc-40f2-8af1-7f6066114b7f service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:49.237483 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-5cec152e-59bc-47aa-ab37-772ce32370c1 req-47884aa4-2ddc-40f2-8af1-7f6066114b7f service nova] Creating event network-changed:54772a5e-157f-44ed-b49a-99e7be75af5e for instance 9141c1ef-36d3-4d8c-bd46-8045891fe3c2 on hv-cinder-83538 Aug 31 19:12:49.248247 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-5cec152e-59bc-47aa-ab37-772ce32370c1 req-47884aa4-2ddc-40f2-8af1-7f6066114b7f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087064 Aug 31 19:12:49.249278 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 46/79] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:12:49.381887 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-d9d1483d-c4e0-4f89-980b-3fe6ab5d926b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:49.390844 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-d9d1483d-c4e0-4f89-980b-3fe6ab5d926b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1322 microversion: 2.1 time: 0.220220 Aug 31 19:12:49.392550 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 34/80] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:49 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:49.915473 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-185b0558-366b-414d-856f-a8ecb9d4c1bb tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:49.916794 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-185b0558-366b-414d-856f-a8ecb9d4c1bb tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:49.923925 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-185b0558-366b-414d-856f-a8ecb9d4c1bb tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:49.924570 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-185b0558-366b-414d-856f-a8ecb9d4c1bb tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:49.925078 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-185b0558-366b-414d-856f-a8ecb9d4c1bb tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:49.925979 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-185b0558-366b-414d-856f-a8ecb9d4c1bb tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:49.926664 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-185b0558-366b-414d-856f-a8ecb9d4c1bb tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:49.927175 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-185b0558-366b-414d-856f-a8ecb9d4c1bb tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:50.075113 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-f3f0bcb5-f0b9-4b80-b5d3-6287b4e4b7ab tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:50.075725 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-f3f0bcb5-f0b9-4b80-b5d3-6287b4e4b7ab tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:50.081817 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f3f0bcb5-f0b9-4b80-b5d3-6287b4e4b7ab tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:50.082635 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f3f0bcb5-f0b9-4b80-b5d3-6287b4e4b7ab tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:50.083393 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f3f0bcb5-f0b9-4b80-b5d3-6287b4e4b7ab tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:50.084240 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f3f0bcb5-f0b9-4b80-b5d3-6287b4e4b7ab tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:50.084688 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f3f0bcb5-f0b9-4b80-b5d3-6287b4e4b7ab tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:50.085154 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f3f0bcb5-f0b9-4b80-b5d3-6287b4e4b7ab tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:50.112516 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-185b0558-366b-414d-856f-a8ecb9d4c1bb tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:50.124905 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-185b0558-366b-414d-856f-a8ecb9d4c1bb tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1367 microversion: 2.1 time: 0.214550 Aug 31 19:12:50.125706 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 47/81] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:49 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:50.413141 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-efb061bb-e4fa-46af-8ed5-bef2244f4618 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:50.414013 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-efb061bb-e4fa-46af-8ed5-bef2244f4618 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:50.420948 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-efb061bb-e4fa-46af-8ed5-bef2244f4618 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:50.421734 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-efb061bb-e4fa-46af-8ed5-bef2244f4618 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:50.422584 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-efb061bb-e4fa-46af-8ed5-bef2244f4618 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:50.423492 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-efb061bb-e4fa-46af-8ed5-bef2244f4618 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:50.424099 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-efb061bb-e4fa-46af-8ed5-bef2244f4618 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:50.425015 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-efb061bb-e4fa-46af-8ed5-bef2244f4618 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:50.444413 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-f3f0bcb5-f0b9-4b80-b5d3-6287b4e4b7ab tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:50.454652 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-f3f0bcb5-f0b9-4b80-b5d3-6287b4e4b7ab tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1314 microversion: 2.1 time: 0.382381 Aug 31 19:12:50.455728 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 35/82] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:50 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1314 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:12:50.597336 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-efb061bb-e4fa-46af-8ed5-bef2244f4618 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:50.606082 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-efb061bb-e4fa-46af-8ed5-bef2244f4618 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1322 microversion: 2.1 time: 0.197567 Aug 31 19:12:50.606640 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 48/83] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:50 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:51.148724 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d739fd46-32a6-4bb7-9773-52c0b8a164ef tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:51.149694 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d739fd46-32a6-4bb7-9773-52c0b8a164ef tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:51.159562 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d739fd46-32a6-4bb7-9773-52c0b8a164ef tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:51.161146 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d739fd46-32a6-4bb7-9773-52c0b8a164ef tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:51.161601 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d739fd46-32a6-4bb7-9773-52c0b8a164ef tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:51.162375 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d739fd46-32a6-4bb7-9773-52c0b8a164ef tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:51.162823 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d739fd46-32a6-4bb7-9773-52c0b8a164ef tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:51.163236 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d739fd46-32a6-4bb7-9773-52c0b8a164ef tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:51.314881 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-d739fd46-32a6-4bb7-9773-52c0b8a164ef tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:51.322884 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-d739fd46-32a6-4bb7-9773-52c0b8a164ef tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1367 microversion: 2.1 time: 0.179277 Aug 31 19:12:51.323455 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 36/84] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:51 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:51.476222 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-e8608dd1-6a2e-4010-b054-fa2dd2aa5855 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:51.476840 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-e8608dd1-6a2e-4010-b054-fa2dd2aa5855 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:51.484530 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e8608dd1-6a2e-4010-b054-fa2dd2aa5855 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:51.485025 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e8608dd1-6a2e-4010-b054-fa2dd2aa5855 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:51.485483 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e8608dd1-6a2e-4010-b054-fa2dd2aa5855 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:51.486358 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e8608dd1-6a2e-4010-b054-fa2dd2aa5855 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:51.486822 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e8608dd1-6a2e-4010-b054-fa2dd2aa5855 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:51.487226 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e8608dd1-6a2e-4010-b054-fa2dd2aa5855 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:51.629305 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-a54fe2b2-15b2-49a1-8a71-8b667f696452 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:51.630152 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-a54fe2b2-15b2-49a1-8a71-8b667f696452 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:51.636439 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a54fe2b2-15b2-49a1-8a71-8b667f696452 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:51.636995 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a54fe2b2-15b2-49a1-8a71-8b667f696452 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:51.637515 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a54fe2b2-15b2-49a1-8a71-8b667f696452 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:51.638362 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a54fe2b2-15b2-49a1-8a71-8b667f696452 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:51.638923 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a54fe2b2-15b2-49a1-8a71-8b667f696452 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:51.639412 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a54fe2b2-15b2-49a1-8a71-8b667f696452 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:51.681312 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-e8608dd1-6a2e-4010-b054-fa2dd2aa5855 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:51.699214 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-e8608dd1-6a2e-4010-b054-fa2dd2aa5855 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1314 microversion: 2.1 time: 0.227092 Aug 31 19:12:51.714536 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 49/85] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:51 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:51.780210 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-a54fe2b2-15b2-49a1-8a71-8b667f696452 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:51.788270 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-a54fe2b2-15b2-49a1-8a71-8b667f696452 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1322 microversion: 2.1 time: 0.162918 Aug 31 19:12:51.788834 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 37/86] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:51 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:12:52.343460 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-76d777d5-4886-4f3c-9344-f1f3799f4990 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:52.344137 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-76d777d5-4886-4f3c-9344-f1f3799f4990 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:52.350131 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-76d777d5-4886-4f3c-9344-f1f3799f4990 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:52.350615 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-76d777d5-4886-4f3c-9344-f1f3799f4990 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:52.351045 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-76d777d5-4886-4f3c-9344-f1f3799f4990 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:52.351732 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-76d777d5-4886-4f3c-9344-f1f3799f4990 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:52.352180 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-76d777d5-4886-4f3c-9344-f1f3799f4990 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:52.352627 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-76d777d5-4886-4f3c-9344-f1f3799f4990 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:52.372808 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=100 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:52.486992 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-76d777d5-4886-4f3c-9344-f1f3799f4990 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:52.495209 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-76d777d5-4886-4f3c-9344-f1f3799f4990 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1367 microversion: 2.1 time: 0.155703 Aug 31 19:12:52.495804 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 50/87] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:52 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:52.721712 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d5e2c175-f0a2-4491-a3d0-324e4d731672 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:52.722354 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d5e2c175-f0a2-4491-a3d0-324e4d731672 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:52.738754 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d5e2c175-f0a2-4491-a3d0-324e4d731672 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:52.739551 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d5e2c175-f0a2-4491-a3d0-324e4d731672 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:52.740374 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d5e2c175-f0a2-4491-a3d0-324e4d731672 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:52.741318 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d5e2c175-f0a2-4491-a3d0-324e4d731672 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:52.741981 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d5e2c175-f0a2-4491-a3d0-324e4d731672 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:52.742628 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d5e2c175-f0a2-4491-a3d0-324e4d731672 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:52.809948 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-7b642c23-4988-49da-970d-13e4fa878000 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:52.810787 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-7b642c23-4988-49da-970d-13e4fa878000 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:52.818608 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7b642c23-4988-49da-970d-13e4fa878000 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:52.819173 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7b642c23-4988-49da-970d-13e4fa878000 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:52.819618 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7b642c23-4988-49da-970d-13e4fa878000 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:52.820627 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7b642c23-4988-49da-970d-13e4fa878000 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:52.821092 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7b642c23-4988-49da-970d-13e4fa878000 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:52.822281 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7b642c23-4988-49da-970d-13e4fa878000 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:53.099942 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-7b642c23-4988-49da-970d-13e4fa878000 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:53.108463 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-7b642c23-4988-49da-970d-13e4fa878000 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1322 microversion: 2.1 time: 0.303730 Aug 31 19:12:53.109985 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 51/88] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:52 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1322 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:53.270312 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-d5e2c175-f0a2-4491-a3d0-324e4d731672 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:53.286640 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-d5e2c175-f0a2-4491-a3d0-324e4d731672 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1314 microversion: 2.1 time: 0.568568 Aug 31 19:12:53.287211 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 38/89] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:52 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1314 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:53.515653 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-421e7332-d77d-468d-aaca-0c7864dcfbe5 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:53.516262 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-421e7332-d77d-468d-aaca-0c7864dcfbe5 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:53.522241 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-421e7332-d77d-468d-aaca-0c7864dcfbe5 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:53.522721 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-421e7332-d77d-468d-aaca-0c7864dcfbe5 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:53.523152 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-421e7332-d77d-468d-aaca-0c7864dcfbe5 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:53.523834 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-421e7332-d77d-468d-aaca-0c7864dcfbe5 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:53.524286 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-421e7332-d77d-468d-aaca-0c7864dcfbe5 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:53.524874 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-421e7332-d77d-468d-aaca-0c7864dcfbe5 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:53.660146 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-421e7332-d77d-468d-aaca-0c7864dcfbe5 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:53.669108 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-421e7332-d77d-468d-aaca-0c7864dcfbe5 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1367 microversion: 2.1 time: 0.157219 Aug 31 19:12:53.670181 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 52/90] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:53 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:54.131747 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-a31ad2b5-950f-4cb4-b893-16d53dfcde78 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:54.132277 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-a31ad2b5-950f-4cb4-b893-16d53dfcde78 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:54.139225 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a31ad2b5-950f-4cb4-b893-16d53dfcde78 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:54.139887 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a31ad2b5-950f-4cb4-b893-16d53dfcde78 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:54.140368 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a31ad2b5-950f-4cb4-b893-16d53dfcde78 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:54.141360 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a31ad2b5-950f-4cb4-b893-16d53dfcde78 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:54.141861 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a31ad2b5-950f-4cb4-b893-16d53dfcde78 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:54.142342 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a31ad2b5-950f-4cb4-b893-16d53dfcde78 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:54.276827 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-a31ad2b5-950f-4cb4-b893-16d53dfcde78 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:54.285240 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-a31ad2b5-950f-4cb4-b893-16d53dfcde78 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1322 microversion: 2.1 time: 0.157331 Aug 31 19:12:54.286170 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 39/91] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:54 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:54.308356 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-99efc836-b1fd-4efd-be26-cffc5ec5e9c7 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:54.308966 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-99efc836-b1fd-4efd-be26-cffc5ec5e9c7 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:54.314928 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-99efc836-b1fd-4efd-be26-cffc5ec5e9c7 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:54.315408 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-99efc836-b1fd-4efd-be26-cffc5ec5e9c7 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:54.315842 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-99efc836-b1fd-4efd-be26-cffc5ec5e9c7 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:54.316526 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-99efc836-b1fd-4efd-be26-cffc5ec5e9c7 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:54.316977 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-99efc836-b1fd-4efd-be26-cffc5ec5e9c7 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:54.317445 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-99efc836-b1fd-4efd-be26-cffc5ec5e9c7 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:54.447344 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-99efc836-b1fd-4efd-be26-cffc5ec5e9c7 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:54.454869 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-99efc836-b1fd-4efd-be26-cffc5ec5e9c7 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1314 microversion: 2.1 time: 0.151027 Aug 31 19:12:54.455435 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 53/92] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:54 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:54.690025 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e26868d5-d6f5-4e4d-8f26-25f8d5e5014b tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:54.690549 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-e26868d5-d6f5-4e4d-8f26-25f8d5e5014b tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:54.696965 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e26868d5-d6f5-4e4d-8f26-25f8d5e5014b tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:54.697484 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e26868d5-d6f5-4e4d-8f26-25f8d5e5014b tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:54.697926 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e26868d5-d6f5-4e4d-8f26-25f8d5e5014b tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:54.698625 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e26868d5-d6f5-4e4d-8f26-25f8d5e5014b tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:54.699104 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e26868d5-d6f5-4e4d-8f26-25f8d5e5014b tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:54.699525 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e26868d5-d6f5-4e4d-8f26-25f8d5e5014b tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:54.835292 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e26868d5-d6f5-4e4d-8f26-25f8d5e5014b tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:54.843645 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-e26868d5-d6f5-4e4d-8f26-25f8d5e5014b tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1367 microversion: 2.1 time: 0.157631 Aug 31 19:12:54.844211 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 40/93] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:54 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:55.306575 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-07ce1140-706d-4bfa-bf73-8f5f200c2c54 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:55.307239 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-07ce1140-706d-4bfa-bf73-8f5f200c2c54 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:55.313774 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-07ce1140-706d-4bfa-bf73-8f5f200c2c54 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:55.314338 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-07ce1140-706d-4bfa-bf73-8f5f200c2c54 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:55.314825 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-07ce1140-706d-4bfa-bf73-8f5f200c2c54 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:55.315669 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-07ce1140-706d-4bfa-bf73-8f5f200c2c54 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:55.316127 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-07ce1140-706d-4bfa-bf73-8f5f200c2c54 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:55.316542 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-07ce1140-706d-4bfa-bf73-8f5f200c2c54 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:55.452299 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-07ce1140-706d-4bfa-bf73-8f5f200c2c54 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:55.460277 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-07ce1140-706d-4bfa-bf73-8f5f200c2c54 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1322 microversion: 2.1 time: 0.158254 Aug 31 19:12:55.460848 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 54/94] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:55 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:55.478767 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-6cb26426-4fb2-42e8-957a-eedea4dba1e3 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:55.479377 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-6cb26426-4fb2-42e8-957a-eedea4dba1e3 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:55.485650 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6cb26426-4fb2-42e8-957a-eedea4dba1e3 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:55.486129 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6cb26426-4fb2-42e8-957a-eedea4dba1e3 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:55.486554 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6cb26426-4fb2-42e8-957a-eedea4dba1e3 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:55.487231 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6cb26426-4fb2-42e8-957a-eedea4dba1e3 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:55.487718 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6cb26426-4fb2-42e8-957a-eedea4dba1e3 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:55.488115 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6cb26426-4fb2-42e8-957a-eedea4dba1e3 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:55.506826 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell0:SELECT=2 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:55.625125 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-6cb26426-4fb2-42e8-957a-eedea4dba1e3 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:55.633173 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-6cb26426-4fb2-42e8-957a-eedea4dba1e3 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1314 microversion: 2.1 time: 0.160340 Aug 31 19:12:55.633767 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 41/95] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:55 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:55.864521 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-157040fc-df3d-443a-93da-381864888f01 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:55.865156 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-157040fc-df3d-443a-93da-381864888f01 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:55.871907 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-157040fc-df3d-443a-93da-381864888f01 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:55.872389 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-157040fc-df3d-443a-93da-381864888f01 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:55.872979 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-157040fc-df3d-443a-93da-381864888f01 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:55.873701 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-157040fc-df3d-443a-93da-381864888f01 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:55.874165 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-157040fc-df3d-443a-93da-381864888f01 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:55.874566 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-157040fc-df3d-443a-93da-381864888f01 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:55.998470 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-157040fc-df3d-443a-93da-381864888f01 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:56.006097 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-157040fc-df3d-443a-93da-381864888f01 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1367 microversion: 2.1 time: 0.145622 Aug 31 19:12:56.006726 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 55/96] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:55 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:56.484183 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-8d15519f-6273-4622-874f-bf3e5a2f12cf tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:56.484818 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-8d15519f-6273-4622-874f-bf3e5a2f12cf tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:56.490731 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8d15519f-6273-4622-874f-bf3e5a2f12cf tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:56.491207 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8d15519f-6273-4622-874f-bf3e5a2f12cf tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:56.491630 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8d15519f-6273-4622-874f-bf3e5a2f12cf tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:56.492303 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8d15519f-6273-4622-874f-bf3e5a2f12cf tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:56.492744 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8d15519f-6273-4622-874f-bf3e5a2f12cf tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:56.493159 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8d15519f-6273-4622-874f-bf3e5a2f12cf tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:56.510145 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=100 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:56.624394 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-8d15519f-6273-4622-874f-bf3e5a2f12cf tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:56.631913 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-8d15519f-6273-4622-874f-bf3e5a2f12cf tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1322 microversion: 2.1 time: 0.152510 Aug 31 19:12:56.632466 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 42/97] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:56 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:56.655027 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-6ae51b54-618c-471d-bed3-01e48e57e66c tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:56.655670 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-6ae51b54-618c-471d-bed3-01e48e57e66c tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:56.661588 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6ae51b54-618c-471d-bed3-01e48e57e66c tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:56.662071 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6ae51b54-618c-471d-bed3-01e48e57e66c tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:56.662503 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6ae51b54-618c-471d-bed3-01e48e57e66c tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:56.663181 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6ae51b54-618c-471d-bed3-01e48e57e66c tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:56.663633 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6ae51b54-618c-471d-bed3-01e48e57e66c tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:56.664051 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6ae51b54-618c-471d-bed3-01e48e57e66c tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:56.793370 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-6ae51b54-618c-471d-bed3-01e48e57e66c tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:56.802316 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-6ae51b54-618c-471d-bed3-01e48e57e66c tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1314 microversion: 2.1 time: 0.151069 Aug 31 19:12:56.802894 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 56/98] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:56 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:57.025967 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-7da6bd8e-a328-4caf-a198-0afa280ea4eb tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:57.026567 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-7da6bd8e-a328-4caf-a198-0afa280ea4eb tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:57.032520 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7da6bd8e-a328-4caf-a198-0afa280ea4eb tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:57.033001 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7da6bd8e-a328-4caf-a198-0afa280ea4eb tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:57.033461 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7da6bd8e-a328-4caf-a198-0afa280ea4eb tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:57.034137 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7da6bd8e-a328-4caf-a198-0afa280ea4eb tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:57.034583 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7da6bd8e-a328-4caf-a198-0afa280ea4eb tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:57.034993 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7da6bd8e-a328-4caf-a198-0afa280ea4eb tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:57.160492 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-7da6bd8e-a328-4caf-a198-0afa280ea4eb tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:57.168026 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-7da6bd8e-a328-4caf-a198-0afa280ea4eb tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1367 microversion: 2.1 time: 0.145825 Aug 31 19:12:57.168579 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 43/99] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:57 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:57.652002 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-bc492b85-c776-4fd1-9c92-7e76cf0bfed4 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:57.652549 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-bc492b85-c776-4fd1-9c92-7e76cf0bfed4 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:57.658410 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bc492b85-c776-4fd1-9c92-7e76cf0bfed4 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:57.658982 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bc492b85-c776-4fd1-9c92-7e76cf0bfed4 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:57.659291 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bc492b85-c776-4fd1-9c92-7e76cf0bfed4 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:57.659960 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bc492b85-c776-4fd1-9c92-7e76cf0bfed4 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:57.660400 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bc492b85-c776-4fd1-9c92-7e76cf0bfed4 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:57.660810 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bc492b85-c776-4fd1-9c92-7e76cf0bfed4 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:57.786546 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-bc492b85-c776-4fd1-9c92-7e76cf0bfed4 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:57.795062 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-bc492b85-c776-4fd1-9c92-7e76cf0bfed4 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1322 microversion: 2.1 time: 0.147051 Aug 31 19:12:57.795632 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 57/100] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:57 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:57.823162 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-81647c04-c237-4275-92bb-c5f1e52886f4 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:57.823772 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-81647c04-c237-4275-92bb-c5f1e52886f4 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:57.830578 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-81647c04-c237-4275-92bb-c5f1e52886f4 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:57.831070 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-81647c04-c237-4275-92bb-c5f1e52886f4 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:57.831504 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-81647c04-c237-4275-92bb-c5f1e52886f4 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:57.832194 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-81647c04-c237-4275-92bb-c5f1e52886f4 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:57.832646 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-81647c04-c237-4275-92bb-c5f1e52886f4 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:57.833071 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-81647c04-c237-4275-92bb-c5f1e52886f4 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:57.970405 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-81647c04-c237-4275-92bb-c5f1e52886f4 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:57.978696 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-81647c04-c237-4275-92bb-c5f1e52886f4 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1314 microversion: 2.1 time: 0.159506 Aug 31 19:12:57.979255 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 44/101] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:57 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:58.188410 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-20281b4c-ee56-4c98-b7fe-26c85e376392 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:58.188959 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-20281b4c-ee56-4c98-b7fe-26c85e376392 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:58.195259 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-20281b4c-ee56-4c98-b7fe-26c85e376392 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:58.195755 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-20281b4c-ee56-4c98-b7fe-26c85e376392 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:58.196192 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-20281b4c-ee56-4c98-b7fe-26c85e376392 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:58.196894 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-20281b4c-ee56-4c98-b7fe-26c85e376392 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:58.197437 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-20281b4c-ee56-4c98-b7fe-26c85e376392 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:58.197776 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-20281b4c-ee56-4c98-b7fe-26c85e376392 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:58.326347 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-20281b4c-ee56-4c98-b7fe-26c85e376392 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:58.334103 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-20281b4c-ee56-4c98-b7fe-26c85e376392 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1367 microversion: 2.1 time: 0.149630 Aug 31 19:12:58.334660 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 58/102] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:58 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:58.815448 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-b3676980-efc0-4748-9ef9-a3e670e5f3e7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:58.816059 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-b3676980-efc0-4748-9ef9-a3e670e5f3e7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:58.823033 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b3676980-efc0-4748-9ef9-a3e670e5f3e7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:58.823517 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b3676980-efc0-4748-9ef9-a3e670e5f3e7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:58.824096 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b3676980-efc0-4748-9ef9-a3e670e5f3e7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:58.824631 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b3676980-efc0-4748-9ef9-a3e670e5f3e7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:58.825081 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b3676980-efc0-4748-9ef9-a3e670e5f3e7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:58.825535 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b3676980-efc0-4748-9ef9-a3e670e5f3e7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:58.958319 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-b3676980-efc0-4748-9ef9-a3e670e5f3e7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:58.966269 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-b3676980-efc0-4748-9ef9-a3e670e5f3e7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1322 microversion: 2.1 time: 0.154793 Aug 31 19:12:58.966829 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 45/103] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:58 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:59.000360 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-7dd847e4-a603-4206-9f67-00231e832034 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:59.000961 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-7dd847e4-a603-4206-9f67-00231e832034 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:59.006770 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7dd847e4-a603-4206-9f67-00231e832034 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:59.007255 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7dd847e4-a603-4206-9f67-00231e832034 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:59.007688 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7dd847e4-a603-4206-9f67-00231e832034 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:59.008366 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7dd847e4-a603-4206-9f67-00231e832034 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:59.008818 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7dd847e4-a603-4206-9f67-00231e832034 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:59.009328 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7dd847e4-a603-4206-9f67-00231e832034 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:59.140536 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-7dd847e4-a603-4206-9f67-00231e832034 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:59.148420 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-7dd847e4-a603-4206-9f67-00231e832034 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1314 microversion: 2.1 time: 0.152089 Aug 31 19:12:59.149001 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 59/104] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:58 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:59.354785 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-2bcc9345-9f70-4a50-8969-f3b432ac0549 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:59.355861 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-2bcc9345-9f70-4a50-8969-f3b432ac0549 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:59.361947 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2bcc9345-9f70-4a50-8969-f3b432ac0549 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:59.362434 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2bcc9345-9f70-4a50-8969-f3b432ac0549 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:59.362864 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2bcc9345-9f70-4a50-8969-f3b432ac0549 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:59.363556 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2bcc9345-9f70-4a50-8969-f3b432ac0549 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:59.364110 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2bcc9345-9f70-4a50-8969-f3b432ac0549 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:59.364542 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2bcc9345-9f70-4a50-8969-f3b432ac0549 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:59.494091 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-2bcc9345-9f70-4a50-8969-f3b432ac0549 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:12:59.501899 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-2bcc9345-9f70-4a50-8969-f3b432ac0549 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1367 microversion: 2.1 time: 0.150953 Aug 31 19:12:59.502655 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 46/105] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:59 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:59.987045 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-9b044d04-0e95-4d00-9c4b-1174be449212 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:59.987640 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-9b044d04-0e95-4d00-9c4b-1174be449212 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:12:59.993554 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9b044d04-0e95-4d00-9c4b-1174be449212 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:59.994026 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9b044d04-0e95-4d00-9c4b-1174be449212 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:59.994443 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9b044d04-0e95-4d00-9c4b-1174be449212 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:12:59.995106 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9b044d04-0e95-4d00-9c4b-1174be449212 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:12:59.995545 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9b044d04-0e95-4d00-9c4b-1174be449212 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:12:59.995951 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9b044d04-0e95-4d00-9c4b-1174be449212 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:00.122771 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-9b044d04-0e95-4d00-9c4b-1174be449212 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:00.130522 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-9b044d04-0e95-4d00-9c4b-1174be449212 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1322 microversion: 2.1 time: 0.147516 Aug 31 19:13:00.131082 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 60/106] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:12:59 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:00.171550 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-b22720e9-1eb3-40e5-abbf-52fe3d411cf0 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:00.172194 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-b22720e9-1eb3-40e5-abbf-52fe3d411cf0 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:00.178616 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b22720e9-1eb3-40e5-abbf-52fe3d411cf0 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:00.179102 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b22720e9-1eb3-40e5-abbf-52fe3d411cf0 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:00.179807 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b22720e9-1eb3-40e5-abbf-52fe3d411cf0 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:00.180633 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b22720e9-1eb3-40e5-abbf-52fe3d411cf0 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:00.181259 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b22720e9-1eb3-40e5-abbf-52fe3d411cf0 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:00.181959 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b22720e9-1eb3-40e5-abbf-52fe3d411cf0 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:00.313015 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-b22720e9-1eb3-40e5-abbf-52fe3d411cf0 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:00.320570 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-b22720e9-1eb3-40e5-abbf-52fe3d411cf0 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1314 microversion: 2.1 time: 0.153730 Aug 31 19:13:00.321767 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 47/107] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:00 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:13:00.521897 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-92f1a9d5-ff56-4fd2-8b91-f506f78cdb6e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:00.522507 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-92f1a9d5-ff56-4fd2-8b91-f506f78cdb6e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:00.529504 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-92f1a9d5-ff56-4fd2-8b91-f506f78cdb6e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:00.529984 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-92f1a9d5-ff56-4fd2-8b91-f506f78cdb6e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:00.530412 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-92f1a9d5-ff56-4fd2-8b91-f506f78cdb6e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:00.531087 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-92f1a9d5-ff56-4fd2-8b91-f506f78cdb6e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:00.531535 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-92f1a9d5-ff56-4fd2-8b91-f506f78cdb6e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:00.531949 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-92f1a9d5-ff56-4fd2-8b91-f506f78cdb6e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:00.667173 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-92f1a9d5-ff56-4fd2-8b91-f506f78cdb6e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:00.674814 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-92f1a9d5-ff56-4fd2-8b91-f506f78cdb6e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1367 microversion: 2.1 time: 0.156747 Aug 31 19:13:00.675369 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 61/108] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:00 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:01.153930 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-b686f78d-7ab3-4aa8-87da-803290d65ed6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:01.154535 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-b686f78d-7ab3-4aa8-87da-803290d65ed6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:01.160507 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b686f78d-7ab3-4aa8-87da-803290d65ed6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:01.161008 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b686f78d-7ab3-4aa8-87da-803290d65ed6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:01.161445 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b686f78d-7ab3-4aa8-87da-803290d65ed6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:01.162123 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b686f78d-7ab3-4aa8-87da-803290d65ed6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:01.162566 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b686f78d-7ab3-4aa8-87da-803290d65ed6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:01.162984 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b686f78d-7ab3-4aa8-87da-803290d65ed6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:01.292800 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-b686f78d-7ab3-4aa8-87da-803290d65ed6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:01.300636 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-b686f78d-7ab3-4aa8-87da-803290d65ed6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1322 microversion: 2.1 time: 0.152102 Aug 31 19:13:01.301210 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 48/109] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:01 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:01.342125 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-8f091959-5ece-4006-a665-6989054f9a40 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:01.342760 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-8f091959-5ece-4006-a665-6989054f9a40 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:01.348673 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8f091959-5ece-4006-a665-6989054f9a40 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:01.349153 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8f091959-5ece-4006-a665-6989054f9a40 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:01.349615 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8f091959-5ece-4006-a665-6989054f9a40 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:01.350295 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8f091959-5ece-4006-a665-6989054f9a40 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:01.350744 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8f091959-5ece-4006-a665-6989054f9a40 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:01.351160 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8f091959-5ece-4006-a665-6989054f9a40 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:01.483205 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-8f091959-5ece-4006-a665-6989054f9a40 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:01.491326 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-8f091959-5ece-4006-a665-6989054f9a40 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1314 microversion: 2.1 time: 0.152978 Aug 31 19:13:01.491952 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 62/110] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:01 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:01.695703 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-a822f08f-5b83-41c4-b7b7-e62a4ebcc0b5 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:01.696417 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-a822f08f-5b83-41c4-b7b7-e62a4ebcc0b5 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:01.702552 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a822f08f-5b83-41c4-b7b7-e62a4ebcc0b5 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:01.702886 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a822f08f-5b83-41c4-b7b7-e62a4ebcc0b5 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:01.703354 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a822f08f-5b83-41c4-b7b7-e62a4ebcc0b5 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:01.704324 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a822f08f-5b83-41c4-b7b7-e62a4ebcc0b5 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:01.704828 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a822f08f-5b83-41c4-b7b7-e62a4ebcc0b5 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:01.705486 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a822f08f-5b83-41c4-b7b7-e62a4ebcc0b5 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:01.851027 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-a822f08f-5b83-41c4-b7b7-e62a4ebcc0b5 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:01.859668 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-a822f08f-5b83-41c4-b7b7-e62a4ebcc0b5 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1367 microversion: 2.1 time: 0.167806 Aug 31 19:13:01.860362 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 49/111] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:01 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:02.321787 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-f6179518-bc33-466e-8e4d-38a448f0f4ea tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:02.322435 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-f6179518-bc33-466e-8e4d-38a448f0f4ea tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:02.328287 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f6179518-bc33-466e-8e4d-38a448f0f4ea tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:02.328829 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f6179518-bc33-466e-8e4d-38a448f0f4ea tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:02.329286 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f6179518-bc33-466e-8e4d-38a448f0f4ea tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:02.329982 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f6179518-bc33-466e-8e4d-38a448f0f4ea tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:02.330434 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f6179518-bc33-466e-8e4d-38a448f0f4ea tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:02.330851 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f6179518-bc33-466e-8e4d-38a448f0f4ea tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:02.476897 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-f6179518-bc33-466e-8e4d-38a448f0f4ea tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:02.490056 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-f6179518-bc33-466e-8e4d-38a448f0f4ea tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1322 microversion: 2.1 time: 0.167903 Aug 31 19:13:02.490056 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 63/112] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:02 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:13:02.512286 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-81997d16-1f85-434e-b774-f0c3319d6351 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:02.512888 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-81997d16-1f85-434e-b774-f0c3319d6351 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:02.519353 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-81997d16-1f85-434e-b774-f0c3319d6351 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:02.519912 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-81997d16-1f85-434e-b774-f0c3319d6351 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:02.520349 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-81997d16-1f85-434e-b774-f0c3319d6351 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:02.521272 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-81997d16-1f85-434e-b774-f0c3319d6351 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:02.521736 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-81997d16-1f85-434e-b774-f0c3319d6351 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:02.522160 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-81997d16-1f85-434e-b774-f0c3319d6351 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:02.661220 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-81997d16-1f85-434e-b774-f0c3319d6351 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:02.670040 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-81997d16-1f85-434e-b774-f0c3319d6351 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1314 microversion: 2.1 time: 0.162101 Aug 31 19:13:02.670612 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 50/113] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:02 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:13:02.884938 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-6a00fde7-c799-487d-88e6-a8d5e7925bc7 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:02.885704 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-6a00fde7-c799-487d-88e6-a8d5e7925bc7 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:02.891617 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6a00fde7-c799-487d-88e6-a8d5e7925bc7 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:02.892095 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6a00fde7-c799-487d-88e6-a8d5e7925bc7 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:02.892521 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6a00fde7-c799-487d-88e6-a8d5e7925bc7 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:02.893213 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6a00fde7-c799-487d-88e6-a8d5e7925bc7 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:02.893658 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6a00fde7-c799-487d-88e6-a8d5e7925bc7 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:02.894333 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6a00fde7-c799-487d-88e6-a8d5e7925bc7 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:03.062957 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-6a00fde7-c799-487d-88e6-a8d5e7925bc7 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:03.071443 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-6a00fde7-c799-487d-88e6-a8d5e7925bc7 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1367 microversion: 2.1 time: 0.190715 Aug 31 19:13:03.071997 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 64/114] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:02 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:03.505942 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-c7f33a66-875d-43e4-af1e-c715f6e439ef tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:03.506871 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-c7f33a66-875d-43e4-af1e-c715f6e439ef tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:03.513322 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c7f33a66-875d-43e4-af1e-c715f6e439ef tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:03.513874 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c7f33a66-875d-43e4-af1e-c715f6e439ef tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:03.514217 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c7f33a66-875d-43e4-af1e-c715f6e439ef tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:03.514889 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c7f33a66-875d-43e4-af1e-c715f6e439ef tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:03.515355 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c7f33a66-875d-43e4-af1e-c715f6e439ef tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:03.515725 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c7f33a66-875d-43e4-af1e-c715f6e439ef tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:03.661266 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-c7f33a66-875d-43e4-af1e-c715f6e439ef tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:03.669691 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-c7f33a66-875d-43e4-af1e-c715f6e439ef tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1322 microversion: 2.1 time: 0.167697 Aug 31 19:13:03.670257 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 51/115] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:03 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:03.691800 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-ebbd6397-2b9b-4938-bafd-a86d378257b9 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:03.692617 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-ebbd6397-2b9b-4938-bafd-a86d378257b9 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:03.699051 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ebbd6397-2b9b-4938-bafd-a86d378257b9 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:03.699518 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ebbd6397-2b9b-4938-bafd-a86d378257b9 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:03.699939 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ebbd6397-2b9b-4938-bafd-a86d378257b9 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:03.700635 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ebbd6397-2b9b-4938-bafd-a86d378257b9 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:03.701084 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ebbd6397-2b9b-4938-bafd-a86d378257b9 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:03.701517 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ebbd6397-2b9b-4938-bafd-a86d378257b9 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:03.836104 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-ebbd6397-2b9b-4938-bafd-a86d378257b9 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:03.844487 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-ebbd6397-2b9b-4938-bafd-a86d378257b9 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1314 microversion: 2.1 time: 0.156588 Aug 31 19:13:03.844994 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 65/116] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:03 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:04.091797 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-55041d22-71ab-4bc2-b4f3-9a3b75cefa57 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:04.092420 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-55041d22-71ab-4bc2-b4f3-9a3b75cefa57 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:04.098628 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-55041d22-71ab-4bc2-b4f3-9a3b75cefa57 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:04.099038 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-55041d22-71ab-4bc2-b4f3-9a3b75cefa57 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:04.099471 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-55041d22-71ab-4bc2-b4f3-9a3b75cefa57 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:04.100158 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-55041d22-71ab-4bc2-b4f3-9a3b75cefa57 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:04.100611 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-55041d22-71ab-4bc2-b4f3-9a3b75cefa57 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:04.101031 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-55041d22-71ab-4bc2-b4f3-9a3b75cefa57 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:04.264591 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-55041d22-71ab-4bc2-b4f3-9a3b75cefa57 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:04.292625 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-55041d22-71ab-4bc2-b4f3-9a3b75cefa57 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1367 microversion: 2.1 time: 0.203171 Aug 31 19:13:04.293482 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 52/117] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:04 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:04.691533 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-bbaeb8b7-1efb-4df6-809f-a728e8823bae tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:04.692263 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-bbaeb8b7-1efb-4df6-809f-a728e8823bae tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:04.699197 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bbaeb8b7-1efb-4df6-809f-a728e8823bae tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:04.699786 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bbaeb8b7-1efb-4df6-809f-a728e8823bae tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:04.700327 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bbaeb8b7-1efb-4df6-809f-a728e8823bae tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:04.701026 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bbaeb8b7-1efb-4df6-809f-a728e8823bae tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:04.701510 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bbaeb8b7-1efb-4df6-809f-a728e8823bae tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:04.702049 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bbaeb8b7-1efb-4df6-809f-a728e8823bae tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:04.856798 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-bbaeb8b7-1efb-4df6-809f-a728e8823bae tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:04.866853 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-bc35b84c-c9c8-4002-af94-dbde25cf8ef2 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:04.867638 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-bc35b84c-c9c8-4002-af94-dbde25cf8ef2 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:04.870562 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-bbaeb8b7-1efb-4df6-809f-a728e8823bae tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1322 microversion: 2.1 time: 0.183630 Aug 31 19:13:04.871137 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 66/118] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:04 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1322 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:04.882266 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bc35b84c-c9c8-4002-af94-dbde25cf8ef2 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:04.883177 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bc35b84c-c9c8-4002-af94-dbde25cf8ef2 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:04.884367 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bc35b84c-c9c8-4002-af94-dbde25cf8ef2 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:04.885714 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bc35b84c-c9c8-4002-af94-dbde25cf8ef2 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:04.886733 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bc35b84c-c9c8-4002-af94-dbde25cf8ef2 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:04.887234 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bc35b84c-c9c8-4002-af94-dbde25cf8ef2 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:05.030498 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-bc35b84c-c9c8-4002-af94-dbde25cf8ef2 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:05.038878 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-bc35b84c-c9c8-4002-af94-dbde25cf8ef2 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1314 microversion: 2.1 time: 0.176840 Aug 31 19:13:05.039428 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 53/119] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:04 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:13:05.314173 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-30c8376d-301e-4448-9f5b-35cc0cd39cac tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:05.314862 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-30c8376d-301e-4448-9f5b-35cc0cd39cac tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:05.321880 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-30c8376d-301e-4448-9f5b-35cc0cd39cac tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:05.322377 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-30c8376d-301e-4448-9f5b-35cc0cd39cac tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:05.322793 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-30c8376d-301e-4448-9f5b-35cc0cd39cac tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:05.323478 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-30c8376d-301e-4448-9f5b-35cc0cd39cac tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:05.323936 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-30c8376d-301e-4448-9f5b-35cc0cd39cac tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:05.324353 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-30c8376d-301e-4448-9f5b-35cc0cd39cac tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:05.328870 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=100 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:13:05.542777 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-30c8376d-301e-4448-9f5b-35cc0cd39cac tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:05.551138 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-30c8376d-301e-4448-9f5b-35cc0cd39cac tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1367 microversion: 2.1 time: 0.240876 Aug 31 19:13:05.551706 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 67/120] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:05 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1367 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:05.893555 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-288a7483-7630-41ca-9ff1-c31315421587 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:05.896122 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-288a7483-7630-41ca-9ff1-c31315421587 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:05.905578 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-288a7483-7630-41ca-9ff1-c31315421587 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:05.907048 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-288a7483-7630-41ca-9ff1-c31315421587 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:05.907889 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-288a7483-7630-41ca-9ff1-c31315421587 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:05.908789 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-288a7483-7630-41ca-9ff1-c31315421587 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:05.909373 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-288a7483-7630-41ca-9ff1-c31315421587 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:05.909950 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-288a7483-7630-41ca-9ff1-c31315421587 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:06.061658 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-fed49808-15d8-4edb-b7f8-6b06df31ddc5 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:06.062930 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-fed49808-15d8-4edb-b7f8-6b06df31ddc5 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:06.079110 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fed49808-15d8-4edb-b7f8-6b06df31ddc5 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:06.079842 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fed49808-15d8-4edb-b7f8-6b06df31ddc5 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:06.080275 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fed49808-15d8-4edb-b7f8-6b06df31ddc5 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:06.080971 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fed49808-15d8-4edb-b7f8-6b06df31ddc5 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:06.081451 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fed49808-15d8-4edb-b7f8-6b06df31ddc5 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:06.081875 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fed49808-15d8-4edb-b7f8-6b06df31ddc5 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:06.090543 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-288a7483-7630-41ca-9ff1-c31315421587 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:06.103429 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-288a7483-7630-41ca-9ff1-c31315421587 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1322 microversion: 2.1 time: 0.214836 Aug 31 19:13:06.117246 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 54/121] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:05 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:06.282960 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-fed49808-15d8-4edb-b7f8-6b06df31ddc5 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:06.295007 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-fed49808-15d8-4edb-b7f8-6b06df31ddc5 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1314 microversion: 2.1 time: 0.235545 Aug 31 19:13:06.315971 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 68/122] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:06 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:06.572365 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-46e61e9a-5825-4e2d-a962-0c1a40828aa4 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:06.572968 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-46e61e9a-5825-4e2d-a962-0c1a40828aa4 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:06.579474 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-46e61e9a-5825-4e2d-a962-0c1a40828aa4 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:06.579988 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-46e61e9a-5825-4e2d-a962-0c1a40828aa4 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:06.580410 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-46e61e9a-5825-4e2d-a962-0c1a40828aa4 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:06.581082 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-46e61e9a-5825-4e2d-a962-0c1a40828aa4 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:06.581548 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-46e61e9a-5825-4e2d-a962-0c1a40828aa4 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:06.581955 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-46e61e9a-5825-4e2d-a962-0c1a40828aa4 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:06.720844 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-46e61e9a-5825-4e2d-a962-0c1a40828aa4 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:06.729072 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-46e61e9a-5825-4e2d-a962-0c1a40828aa4 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1367 microversion: 2.1 time: 0.160609 Aug 31 19:13:06.729682 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 55/123] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:06 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:13:07.127538 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-c105f70f-f2c1-40b1-9fef-44163d1f5e1a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:07.128293 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-c105f70f-f2c1-40b1-9fef-44163d1f5e1a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:07.135681 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c105f70f-f2c1-40b1-9fef-44163d1f5e1a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:07.136823 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c105f70f-f2c1-40b1-9fef-44163d1f5e1a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:07.136823 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c105f70f-f2c1-40b1-9fef-44163d1f5e1a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:07.137127 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c105f70f-f2c1-40b1-9fef-44163d1f5e1a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:07.137597 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c105f70f-f2c1-40b1-9fef-44163d1f5e1a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:07.138091 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c105f70f-f2c1-40b1-9fef-44163d1f5e1a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:07.270133 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-c105f70f-f2c1-40b1-9fef-44163d1f5e1a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:07.277753 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-c105f70f-f2c1-40b1-9fef-44163d1f5e1a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1322 microversion: 2.1 time: 0.154165 Aug 31 19:13:07.278319 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 69/124] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:07 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:07.319643 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-0f87e04a-ad21-4e0b-9a8f-f7639b95de29 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:07.320252 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-0f87e04a-ad21-4e0b-9a8f-f7639b95de29 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:07.322812 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=74 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:13:07.327801 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0f87e04a-ad21-4e0b-9a8f-f7639b95de29 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:07.328318 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0f87e04a-ad21-4e0b-9a8f-f7639b95de29 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:07.328748 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0f87e04a-ad21-4e0b-9a8f-f7639b95de29 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:07.329457 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0f87e04a-ad21-4e0b-9a8f-f7639b95de29 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:07.329906 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0f87e04a-ad21-4e0b-9a8f-f7639b95de29 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:07.330322 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0f87e04a-ad21-4e0b-9a8f-f7639b95de29 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:07.460180 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-0f87e04a-ad21-4e0b-9a8f-f7639b95de29 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:07.467766 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-0f87e04a-ad21-4e0b-9a8f-f7639b95de29 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1314 microversion: 2.1 time: 0.151890 Aug 31 19:13:07.468355 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 56/125] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:07 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:07.749963 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-f2b14695-0cfd-4ecc-b0dd-5ec52d4670f3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:07.750516 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-f2b14695-0cfd-4ecc-b0dd-5ec52d4670f3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:07.756577 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f2b14695-0cfd-4ecc-b0dd-5ec52d4670f3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:07.757057 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f2b14695-0cfd-4ecc-b0dd-5ec52d4670f3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:07.757520 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f2b14695-0cfd-4ecc-b0dd-5ec52d4670f3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:07.758198 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f2b14695-0cfd-4ecc-b0dd-5ec52d4670f3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:07.758666 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f2b14695-0cfd-4ecc-b0dd-5ec52d4670f3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:07.759082 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f2b14695-0cfd-4ecc-b0dd-5ec52d4670f3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:07.890202 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-f2b14695-0cfd-4ecc-b0dd-5ec52d4670f3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:07.898338 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-f2b14695-0cfd-4ecc-b0dd-5ec52d4670f3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1367 microversion: 2.1 time: 0.152189 Aug 31 19:13:07.898843 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 70/126] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:07 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:08.300528 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-2c868dc0-97db-40aa-b287-72fa5cd734cd tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:08.300528 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-2c868dc0-97db-40aa-b287-72fa5cd734cd tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:08.306802 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2c868dc0-97db-40aa-b287-72fa5cd734cd tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:08.307323 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2c868dc0-97db-40aa-b287-72fa5cd734cd tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:08.307738 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2c868dc0-97db-40aa-b287-72fa5cd734cd tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:08.308423 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2c868dc0-97db-40aa-b287-72fa5cd734cd tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:08.308875 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2c868dc0-97db-40aa-b287-72fa5cd734cd tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:08.309382 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2c868dc0-97db-40aa-b287-72fa5cd734cd tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:08.474241 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-2c868dc0-97db-40aa-b287-72fa5cd734cd tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:08.481866 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-2c868dc0-97db-40aa-b287-72fa5cd734cd tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1322 microversion: 2.1 time: 0.187595 Aug 31 19:13:08.482654 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 57/127] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:08 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:13:08.490081 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-e6c80405-62c5-410a-9275-08fe87e56f66 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:08.490684 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-e6c80405-62c5-410a-9275-08fe87e56f66 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:08.496439 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e6c80405-62c5-410a-9275-08fe87e56f66 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:08.496931 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e6c80405-62c5-410a-9275-08fe87e56f66 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:08.497379 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e6c80405-62c5-410a-9275-08fe87e56f66 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:08.498055 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e6c80405-62c5-410a-9275-08fe87e56f66 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:08.498502 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e6c80405-62c5-410a-9275-08fe87e56f66 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:08.498918 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e6c80405-62c5-410a-9275-08fe87e56f66 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:08.628533 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-e6c80405-62c5-410a-9275-08fe87e56f66 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:08.637351 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-e6c80405-62c5-410a-9275-08fe87e56f66 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1314 microversion: 2.1 time: 0.150867 Aug 31 19:13:08.637927 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 71/128] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:08 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:08.919395 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-7760f2d8-2a56-4d1b-a04d-c9f1d6285ab6 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:08.919994 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-7760f2d8-2a56-4d1b-a04d-c9f1d6285ab6 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:08.928716 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7760f2d8-2a56-4d1b-a04d-c9f1d6285ab6 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:08.929593 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7760f2d8-2a56-4d1b-a04d-c9f1d6285ab6 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:08.930831 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7760f2d8-2a56-4d1b-a04d-c9f1d6285ab6 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:08.931998 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7760f2d8-2a56-4d1b-a04d-c9f1d6285ab6 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:08.932733 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7760f2d8-2a56-4d1b-a04d-c9f1d6285ab6 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:08.933452 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7760f2d8-2a56-4d1b-a04d-c9f1d6285ab6 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:09.064989 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-7760f2d8-2a56-4d1b-a04d-c9f1d6285ab6 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:09.072619 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-7760f2d8-2a56-4d1b-a04d-c9f1d6285ab6 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1367 microversion: 2.1 time: 0.157120 Aug 31 19:13:09.073217 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 58/129] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:08 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:09.503565 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-8751679d-7581-43a1-8fc5-6a8c63ba3a30 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:09.504191 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-8751679d-7581-43a1-8fc5-6a8c63ba3a30 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:09.511155 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8751679d-7581-43a1-8fc5-6a8c63ba3a30 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:09.511637 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8751679d-7581-43a1-8fc5-6a8c63ba3a30 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:09.512063 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8751679d-7581-43a1-8fc5-6a8c63ba3a30 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:09.512774 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8751679d-7581-43a1-8fc5-6a8c63ba3a30 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:09.513239 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8751679d-7581-43a1-8fc5-6a8c63ba3a30 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:09.513656 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8751679d-7581-43a1-8fc5-6a8c63ba3a30 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:09.658214 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-42923d0c-fd49-4331-b5c9-c136e5ac24ac tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:09.658927 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-42923d0c-fd49-4331-b5c9-c136e5ac24ac tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:09.669733 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-42923d0c-fd49-4331-b5c9-c136e5ac24ac tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:09.670202 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-42923d0c-fd49-4331-b5c9-c136e5ac24ac tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:09.670644 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-42923d0c-fd49-4331-b5c9-c136e5ac24ac tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:09.671365 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-42923d0c-fd49-4331-b5c9-c136e5ac24ac tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:09.671818 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-42923d0c-fd49-4331-b5c9-c136e5ac24ac tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:09.672238 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-42923d0c-fd49-4331-b5c9-c136e5ac24ac tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:09.694198 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=100 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:13:09.835456 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-8751679d-7581-43a1-8fc5-6a8c63ba3a30 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:09.839860 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-42923d0c-fd49-4331-b5c9-c136e5ac24ac tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:09.844516 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-8751679d-7581-43a1-8fc5-6a8c63ba3a30 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1322 microversion: 2.1 time: 0.345814 Aug 31 19:13:09.847957 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-42923d0c-fd49-4331-b5c9-c136e5ac24ac tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1314 microversion: 2.1 time: 0.193665 Aug 31 19:13:09.849547 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 59/130] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:09 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:13:09.854150 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 72/131] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:09 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1322 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:10.093627 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-70bac90e-f7be-40f6-98e0-422eae9088a9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:10.094227 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-70bac90e-f7be-40f6-98e0-422eae9088a9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:10.100341 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-70bac90e-f7be-40f6-98e0-422eae9088a9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:10.100833 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-70bac90e-f7be-40f6-98e0-422eae9088a9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:10.101295 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-70bac90e-f7be-40f6-98e0-422eae9088a9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:10.101979 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-70bac90e-f7be-40f6-98e0-422eae9088a9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:10.102432 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-70bac90e-f7be-40f6-98e0-422eae9088a9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:10.102852 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-70bac90e-f7be-40f6-98e0-422eae9088a9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:10.232580 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-70bac90e-f7be-40f6-98e0-422eae9088a9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:10.240844 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-70bac90e-f7be-40f6-98e0-422eae9088a9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1367 microversion: 2.1 time: 0.150820 Aug 31 19:13:10.241461 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 60/132] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:10 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:10.865121 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-1dc7e55d-0c4c-4b01-aef6-329c24aec84e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:10.865879 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-1dc7e55d-0c4c-4b01-aef6-329c24aec84e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:10.868156 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-8e1b1793-9994-446c-9861-c5b390309bb0 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:10.869414 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-8e1b1793-9994-446c-9861-c5b390309bb0 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:10.872271 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1dc7e55d-0c4c-4b01-aef6-329c24aec84e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:10.872750 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1dc7e55d-0c4c-4b01-aef6-329c24aec84e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:10.873176 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1dc7e55d-0c4c-4b01-aef6-329c24aec84e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:10.873926 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1dc7e55d-0c4c-4b01-aef6-329c24aec84e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:10.874329 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1dc7e55d-0c4c-4b01-aef6-329c24aec84e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:10.874830 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1dc7e55d-0c4c-4b01-aef6-329c24aec84e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:10.875389 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8e1b1793-9994-446c-9861-c5b390309bb0 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:10.875932 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8e1b1793-9994-446c-9861-c5b390309bb0 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:10.876867 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8e1b1793-9994-446c-9861-c5b390309bb0 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:10.878103 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8e1b1793-9994-446c-9861-c5b390309bb0 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:10.879209 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8e1b1793-9994-446c-9861-c5b390309bb0 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:10.879937 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8e1b1793-9994-446c-9861-c5b390309bb0 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:11.024294 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-8e1b1793-9994-446c-9861-c5b390309bb0 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:11.024738 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-1dc7e55d-0c4c-4b01-aef6-329c24aec84e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:11.032169 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-8e1b1793-9994-446c-9861-c5b390309bb0 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1314 microversion: 2.1 time: 0.168333 Aug 31 19:13:11.032343 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-1dc7e55d-0c4c-4b01-aef6-329c24aec84e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1322 microversion: 2.1 time: 0.171025 Aug 31 19:13:11.032739 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 61/133] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:10 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:13:11.032917 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 73/134] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:10 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:11.262294 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-43621843-38ed-426a-9aba-2054c15a505a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:11.262894 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-43621843-38ed-426a-9aba-2054c15a505a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:11.268821 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-43621843-38ed-426a-9aba-2054c15a505a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:11.269314 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-43621843-38ed-426a-9aba-2054c15a505a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:11.269731 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-43621843-38ed-426a-9aba-2054c15a505a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:11.270408 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-43621843-38ed-426a-9aba-2054c15a505a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:11.270847 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-43621843-38ed-426a-9aba-2054c15a505a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:11.271255 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-43621843-38ed-426a-9aba-2054c15a505a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:11.396511 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-43621843-38ed-426a-9aba-2054c15a505a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:11.404737 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-43621843-38ed-426a-9aba-2054c15a505a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1367 microversion: 2.1 time: 0.146896 Aug 31 19:13:11.405317 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 62/135] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:11 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:12.051692 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-d78e789b-4219-46ca-abe6-9d3c3bc0d60d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:12.052308 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-d78e789b-4219-46ca-abe6-9d3c3bc0d60d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:12.052918 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-bea737d4-7b43-4e53-817b-c1f0a1dfab08 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:12.053747 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-bea737d4-7b43-4e53-817b-c1f0a1dfab08 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:12.059116 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d78e789b-4219-46ca-abe6-9d3c3bc0d60d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:12.059546 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d78e789b-4219-46ca-abe6-9d3c3bc0d60d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:12.059966 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d78e789b-4219-46ca-abe6-9d3c3bc0d60d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:12.060647 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d78e789b-4219-46ca-abe6-9d3c3bc0d60d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:12.060750 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bea737d4-7b43-4e53-817b-c1f0a1dfab08 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:12.061093 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d78e789b-4219-46ca-abe6-9d3c3bc0d60d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:12.061216 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bea737d4-7b43-4e53-817b-c1f0a1dfab08 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:12.061545 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d78e789b-4219-46ca-abe6-9d3c3bc0d60d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:12.061659 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bea737d4-7b43-4e53-817b-c1f0a1dfab08 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:12.062347 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bea737d4-7b43-4e53-817b-c1f0a1dfab08 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:12.062801 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bea737d4-7b43-4e53-817b-c1f0a1dfab08 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:12.063223 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bea737d4-7b43-4e53-817b-c1f0a1dfab08 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:12.191843 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-bea737d4-7b43-4e53-817b-c1f0a1dfab08 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:12.195275 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-d78e789b-4219-46ca-abe6-9d3c3bc0d60d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:12.200505 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-bea737d4-7b43-4e53-817b-c1f0a1dfab08 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1314 microversion: 2.1 time: 0.151304 Aug 31 19:13:12.201538 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 63/136] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:12 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:13:12.205200 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-d78e789b-4219-46ca-abe6-9d3c3bc0d60d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1322 microversion: 2.1 time: 0.157192 Aug 31 19:13:12.205765 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 74/137] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:12 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:12.425094 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e9c5fa5e-c821-4bf2-8c5c-ace34a0d4cd3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:12.425748 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-e9c5fa5e-c821-4bf2-8c5c-ace34a0d4cd3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:12.431765 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e9c5fa5e-c821-4bf2-8c5c-ace34a0d4cd3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:12.432247 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e9c5fa5e-c821-4bf2-8c5c-ace34a0d4cd3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:12.432687 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e9c5fa5e-c821-4bf2-8c5c-ace34a0d4cd3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:12.433403 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e9c5fa5e-c821-4bf2-8c5c-ace34a0d4cd3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:12.433859 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e9c5fa5e-c821-4bf2-8c5c-ace34a0d4cd3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:12.434279 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e9c5fa5e-c821-4bf2-8c5c-ace34a0d4cd3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:12.564075 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e9c5fa5e-c821-4bf2-8c5c-ace34a0d4cd3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:12.571884 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-e9c5fa5e-c821-4bf2-8c5c-ace34a0d4cd3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1367 microversion: 2.1 time: 0.150631 Aug 31 19:13:12.572425 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 64/138] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:12 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:13.221529 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-930b5e46-8690-48fd-b4dc-abf42ea342d1 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:13.222061 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-930b5e46-8690-48fd-b4dc-abf42ea342d1 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:13.224643 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-7c7c89e0-dd3b-4977-81e8-9abf536be9d6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:13.225273 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-7c7c89e0-dd3b-4977-81e8-9abf536be9d6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:13.228685 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-930b5e46-8690-48fd-b4dc-abf42ea342d1 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:13.229166 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-930b5e46-8690-48fd-b4dc-abf42ea342d1 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:13.229894 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-930b5e46-8690-48fd-b4dc-abf42ea342d1 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:13.230607 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-930b5e46-8690-48fd-b4dc-abf42ea342d1 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:13.231049 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-930b5e46-8690-48fd-b4dc-abf42ea342d1 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:13.231461 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-930b5e46-8690-48fd-b4dc-abf42ea342d1 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:13.231801 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7c7c89e0-dd3b-4977-81e8-9abf536be9d6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:13.232286 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7c7c89e0-dd3b-4977-81e8-9abf536be9d6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:13.232713 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7c7c89e0-dd3b-4977-81e8-9abf536be9d6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:13.233694 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7c7c89e0-dd3b-4977-81e8-9abf536be9d6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:13.234151 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7c7c89e0-dd3b-4977-81e8-9abf536be9d6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:13.234564 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7c7c89e0-dd3b-4977-81e8-9abf536be9d6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:13.360310 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-7c7c89e0-dd3b-4977-81e8-9abf536be9d6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:13.361060 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-930b5e46-8690-48fd-b4dc-abf42ea342d1 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:13.368006 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-7c7c89e0-dd3b-4977-81e8-9abf536be9d6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1322 microversion: 2.1 time: 0.147068 Aug 31 19:13:13.368563 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 65/139] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:13 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:13:13.368749 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-930b5e46-8690-48fd-b4dc-abf42ea342d1 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1314 microversion: 2.1 time: 0.151447 Aug 31 19:13:13.369477 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 75/140] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:13 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:13.593065 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-6d97dad6-6435-4c44-97c0-66d9a7b715cf tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:13.593785 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-6d97dad6-6435-4c44-97c0-66d9a7b715cf tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:13.599931 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6d97dad6-6435-4c44-97c0-66d9a7b715cf tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:13.600416 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6d97dad6-6435-4c44-97c0-66d9a7b715cf tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:13.600847 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6d97dad6-6435-4c44-97c0-66d9a7b715cf tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:13.601570 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6d97dad6-6435-4c44-97c0-66d9a7b715cf tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:13.602056 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6d97dad6-6435-4c44-97c0-66d9a7b715cf tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:13.602475 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6d97dad6-6435-4c44-97c0-66d9a7b715cf tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:13.746007 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-6d97dad6-6435-4c44-97c0-66d9a7b715cf tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:13.753565 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-6d97dad6-6435-4c44-97c0-66d9a7b715cf tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1367 microversion: 2.1 time: 0.164517 Aug 31 19:13:13.754127 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 66/141] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:13 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:14.388973 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-6de62890-0531-4570-bdcc-c53846c40da6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:14.389618 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-6de62890-0531-4570-bdcc-c53846c40da6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:14.391505 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-f69f2b0a-8762-4873-bcac-14f633c862a3 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:14.392215 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-f69f2b0a-8762-4873-bcac-14f633c862a3 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:14.395899 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6de62890-0531-4570-bdcc-c53846c40da6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:14.396383 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6de62890-0531-4570-bdcc-c53846c40da6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:14.397005 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6de62890-0531-4570-bdcc-c53846c40da6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:14.397755 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6de62890-0531-4570-bdcc-c53846c40da6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:14.398195 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6de62890-0531-4570-bdcc-c53846c40da6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:14.398607 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6de62890-0531-4570-bdcc-c53846c40da6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:14.399911 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f69f2b0a-8762-4873-bcac-14f633c862a3 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:14.400378 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f69f2b0a-8762-4873-bcac-14f633c862a3 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:14.400805 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f69f2b0a-8762-4873-bcac-14f633c862a3 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:14.401585 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f69f2b0a-8762-4873-bcac-14f633c862a3 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:14.402046 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f69f2b0a-8762-4873-bcac-14f633c862a3 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:14.402470 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f69f2b0a-8762-4873-bcac-14f633c862a3 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:14.534148 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-f69f2b0a-8762-4873-bcac-14f633c862a3 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:14.540928 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-6de62890-0531-4570-bdcc-c53846c40da6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:14.541759 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-f69f2b0a-8762-4873-bcac-14f633c862a3 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1314 microversion: 2.1 time: 0.154701 Aug 31 19:13:14.542322 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 67/142] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:14 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:14.549133 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-6de62890-0531-4570-bdcc-c53846c40da6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1322 microversion: 2.1 time: 0.164431 Aug 31 19:13:14.549733 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 76/143] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:14 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:14.774422 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-7474ec7d-1979-4350-9697-0af06c0bdc17 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:14.775192 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-7474ec7d-1979-4350-9697-0af06c0bdc17 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:14.781061 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7474ec7d-1979-4350-9697-0af06c0bdc17 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:14.781563 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7474ec7d-1979-4350-9697-0af06c0bdc17 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:14.781987 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7474ec7d-1979-4350-9697-0af06c0bdc17 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:14.782706 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7474ec7d-1979-4350-9697-0af06c0bdc17 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:14.783155 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7474ec7d-1979-4350-9697-0af06c0bdc17 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:14.783563 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7474ec7d-1979-4350-9697-0af06c0bdc17 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:14.919875 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-7474ec7d-1979-4350-9697-0af06c0bdc17 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:14.931658 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-7474ec7d-1979-4350-9697-0af06c0bdc17 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1367 microversion: 2.1 time: 0.160110 Aug 31 19:13:14.932310 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 68/144] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:14 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:15.563763 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-2eca70b6-55a5-42ee-beae-564785751c69 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:15.564375 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-2eca70b6-55a5-42ee-beae-564785751c69 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:15.566620 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_api:SELECT=72 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:13:15.571795 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-46ab9ce4-8973-4a96-ae67-749506f1d432 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:15.572227 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2eca70b6-55a5-42ee-beae-564785751c69 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:15.572399 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-46ab9ce4-8973-4a96-ae67-749506f1d432 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:15.572511 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2eca70b6-55a5-42ee-beae-564785751c69 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:15.572845 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2eca70b6-55a5-42ee-beae-564785751c69 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:15.573803 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2eca70b6-55a5-42ee-beae-564785751c69 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:15.574292 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2eca70b6-55a5-42ee-beae-564785751c69 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:15.574713 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2eca70b6-55a5-42ee-beae-564785751c69 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:15.580158 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-46ab9ce4-8973-4a96-ae67-749506f1d432 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:15.580640 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-46ab9ce4-8973-4a96-ae67-749506f1d432 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:15.581070 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-46ab9ce4-8973-4a96-ae67-749506f1d432 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:15.581788 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-46ab9ce4-8973-4a96-ae67-749506f1d432 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:15.582233 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-46ab9ce4-8973-4a96-ae67-749506f1d432 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:15.582648 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-46ab9ce4-8973-4a96-ae67-749506f1d432 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:15.716022 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-2eca70b6-55a5-42ee-beae-564785751c69 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:15.720795 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-46ab9ce4-8973-4a96-ae67-749506f1d432 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:15.724108 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-2eca70b6-55a5-42ee-beae-564785751c69 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1314 microversion: 2.1 time: 0.164629 Aug 31 19:13:15.724764 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 77/145] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:15 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:15.728866 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-46ab9ce4-8973-4a96-ae67-749506f1d432 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1322 microversion: 2.1 time: 0.162137 Aug 31 19:13:15.729435 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 69/146] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:15 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:15.954171 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-f1a1f296-3064-492a-b51b-54e3dc4df9c5 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:15.954892 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-f1a1f296-3064-492a-b51b-54e3dc4df9c5 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:15.961410 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f1a1f296-3064-492a-b51b-54e3dc4df9c5 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:15.961978 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f1a1f296-3064-492a-b51b-54e3dc4df9c5 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:15.963093 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f1a1f296-3064-492a-b51b-54e3dc4df9c5 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:15.963848 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f1a1f296-3064-492a-b51b-54e3dc4df9c5 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:15.964489 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f1a1f296-3064-492a-b51b-54e3dc4df9c5 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:15.965084 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f1a1f296-3064-492a-b51b-54e3dc4df9c5 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:16.131707 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-f1a1f296-3064-492a-b51b-54e3dc4df9c5 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:16.141497 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-f1a1f296-3064-492a-b51b-54e3dc4df9c5 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1367 microversion: 2.1 time: 0.191629 Aug 31 19:13:16.142075 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 78/147] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:15 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1367 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:16.267913 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-0545ad30-961e-4d50-9b7b-6f65bad09138 req-1b6e05e3-40c8-445d-8003-0a12ddbbb3f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb", "name": "network-vif-plugged", "status": "completed", "tag": "1adf99e2-adb2-4055-815e-64ce31792411"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:13:16.279452 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-0545ad30-961e-4d50-9b7b-6f65bad09138 req-1b6e05e3-40c8-445d-8003-0a12ddbbb3f7 service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:16.280083 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-0545ad30-961e-4d50-9b7b-6f65bad09138 req-1b6e05e3-40c8-445d-8003-0a12ddbbb3f7 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:16.280452 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-0545ad30-961e-4d50-9b7b-6f65bad09138 req-1b6e05e3-40c8-445d-8003-0a12ddbbb3f7 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:16.298248 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-0545ad30-961e-4d50-9b7b-6f65bad09138 req-1b6e05e3-40c8-445d-8003-0a12ddbbb3f7 service nova] Creating event network-vif-plugged:1adf99e2-adb2-4055-815e-64ce31792411 for instance e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb on hv-cinder-83538 Aug 31 19:13:16.303882 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-0545ad30-961e-4d50-9b7b-6f65bad09138 req-1b6e05e3-40c8-445d-8003-0a12ddbbb3f7 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123127 Aug 31 19:13:16.304657 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 70/148] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:13:16.746645 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-6d4efe78-c3f3-4bc3-8a9a-d540d1970762 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:16.747159 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-6d4efe78-c3f3-4bc3-8a9a-d540d1970762 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:16.749883 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e40a4a2b-3db3-418d-b67f-b9fc2938690c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:16.750582 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-e40a4a2b-3db3-418d-b67f-b9fc2938690c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:16.753012 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6d4efe78-c3f3-4bc3-8a9a-d540d1970762 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:16.753540 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6d4efe78-c3f3-4bc3-8a9a-d540d1970762 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:16.753966 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6d4efe78-c3f3-4bc3-8a9a-d540d1970762 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:16.754677 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6d4efe78-c3f3-4bc3-8a9a-d540d1970762 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:16.755128 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6d4efe78-c3f3-4bc3-8a9a-d540d1970762 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:16.755549 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6d4efe78-c3f3-4bc3-8a9a-d540d1970762 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:16.756710 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e40a4a2b-3db3-418d-b67f-b9fc2938690c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:16.757208 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e40a4a2b-3db3-418d-b67f-b9fc2938690c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:16.757647 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e40a4a2b-3db3-418d-b67f-b9fc2938690c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:16.758323 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e40a4a2b-3db3-418d-b67f-b9fc2938690c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:16.758772 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e40a4a2b-3db3-418d-b67f-b9fc2938690c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:16.759223 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e40a4a2b-3db3-418d-b67f-b9fc2938690c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:16.890272 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-6d4efe78-c3f3-4bc3-8a9a-d540d1970762 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:16.891066 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e40a4a2b-3db3-418d-b67f-b9fc2938690c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:16.898473 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-6d4efe78-c3f3-4bc3-8a9a-d540d1970762 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1314 microversion: 2.1 time: 0.156668 Aug 31 19:13:16.898997 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-e40a4a2b-3db3-418d-b67f-b9fc2938690c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1322 microversion: 2.1 time: 0.153167 Aug 31 19:13:16.899100 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 79/149] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:16 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:16.900327 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 71/150] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:16 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:13:17.162652 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-b4157620-6096-442d-ae07-0eb35ab72be3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:17.163283 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-b4157620-6096-442d-ae07-0eb35ab72be3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:17.170049 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b4157620-6096-442d-ae07-0eb35ab72be3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:17.170533 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b4157620-6096-442d-ae07-0eb35ab72be3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:17.170963 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b4157620-6096-442d-ae07-0eb35ab72be3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:17.171686 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b4157620-6096-442d-ae07-0eb35ab72be3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:17.172135 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b4157620-6096-442d-ae07-0eb35ab72be3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:17.172553 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b4157620-6096-442d-ae07-0eb35ab72be3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:17.319365 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-b4157620-6096-442d-ae07-0eb35ab72be3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:17.330424 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-b4157620-6096-442d-ae07-0eb35ab72be3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1367 microversion: 2.1 time: 0.171487 Aug 31 19:13:17.331670 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 80/151] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:17 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:17.920416 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-3628b276-f047-4cf8-8093-54209778f670 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:17.920943 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-11d8e82b-f958-4f65-bc4f-0f291587691a tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:17.920943 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-11d8e82b-f958-4f65-bc4f-0f291587691a tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:17.921375 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-3628b276-f047-4cf8-8093-54209778f670 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:17.926857 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-11d8e82b-f958-4f65-bc4f-0f291587691a tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:17.927007 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3628b276-f047-4cf8-8093-54209778f670 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:17.927335 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-11d8e82b-f958-4f65-bc4f-0f291587691a tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:17.927431 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3628b276-f047-4cf8-8093-54209778f670 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:17.927761 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-11d8e82b-f958-4f65-bc4f-0f291587691a tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:17.927865 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3628b276-f047-4cf8-8093-54209778f670 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:17.928439 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-11d8e82b-f958-4f65-bc4f-0f291587691a tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:17.928534 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3628b276-f047-4cf8-8093-54209778f670 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:17.928889 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-11d8e82b-f958-4f65-bc4f-0f291587691a tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:17.928982 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3628b276-f047-4cf8-8093-54209778f670 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:17.929349 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-11d8e82b-f958-4f65-bc4f-0f291587691a tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:17.929447 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3628b276-f047-4cf8-8093-54209778f670 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:18.061765 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-11d8e82b-f958-4f65-bc4f-0f291587691a tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:18.066043 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-3628b276-f047-4cf8-8093-54209778f670 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:18.069745 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-11d8e82b-f958-4f65-bc4f-0f291587691a tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1314 microversion: 2.1 time: 0.153047 Aug 31 19:13:18.070749 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 81/152] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:17 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:13:18.074672 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-3628b276-f047-4cf8-8093-54209778f670 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1322 microversion: 2.1 time: 0.158172 Aug 31 19:13:18.084045 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 72/153] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:17 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:18.353261 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-40c64e16-5ccc-4b68-b803-d30efa0f34e4 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:18.354173 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-40c64e16-5ccc-4b68-b803-d30efa0f34e4 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:18.364220 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-40c64e16-5ccc-4b68-b803-d30efa0f34e4 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:18.364220 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-40c64e16-5ccc-4b68-b803-d30efa0f34e4 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:18.364220 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-40c64e16-5ccc-4b68-b803-d30efa0f34e4 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:18.364220 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-40c64e16-5ccc-4b68-b803-d30efa0f34e4 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:18.364568 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-40c64e16-5ccc-4b68-b803-d30efa0f34e4 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:18.364568 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-40c64e16-5ccc-4b68-b803-d30efa0f34e4 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:18.509845 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-40c64e16-5ccc-4b68-b803-d30efa0f34e4 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:18.520313 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-40c64e16-5ccc-4b68-b803-d30efa0f34e4 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1367 microversion: 2.1 time: 0.172789 Aug 31 19:13:18.520865 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 82/154] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:18 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:19.091387 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-1a72d25a-bc34-44ea-a5c2-bc73db7973a5 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:19.092010 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-1a72d25a-bc34-44ea-a5c2-bc73db7973a5 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:19.095224 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-c3cc50fd-d3ed-41c8-81f9-abc6c0a990e1 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:19.095834 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-c3cc50fd-d3ed-41c8-81f9-abc6c0a990e1 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:19.098082 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1a72d25a-bc34-44ea-a5c2-bc73db7973a5 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:19.098568 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1a72d25a-bc34-44ea-a5c2-bc73db7973a5 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:19.098999 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1a72d25a-bc34-44ea-a5c2-bc73db7973a5 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:19.099681 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1a72d25a-bc34-44ea-a5c2-bc73db7973a5 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:19.100133 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1a72d25a-bc34-44ea-a5c2-bc73db7973a5 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:19.100555 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1a72d25a-bc34-44ea-a5c2-bc73db7973a5 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:19.101619 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c3cc50fd-d3ed-41c8-81f9-abc6c0a990e1 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:19.102103 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c3cc50fd-d3ed-41c8-81f9-abc6c0a990e1 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:19.102535 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c3cc50fd-d3ed-41c8-81f9-abc6c0a990e1 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:19.103243 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c3cc50fd-d3ed-41c8-81f9-abc6c0a990e1 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:19.103695 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c3cc50fd-d3ed-41c8-81f9-abc6c0a990e1 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:19.104119 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c3cc50fd-d3ed-41c8-81f9-abc6c0a990e1 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:19.228886 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1a72d25a-bc34-44ea-a5c2-bc73db7973a5 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:19.231265 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-c3cc50fd-d3ed-41c8-81f9-abc6c0a990e1 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:19.235030 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=100 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:13:19.238390 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-1a72d25a-bc34-44ea-a5c2-bc73db7973a5 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1314 microversion: 2.1 time: 0.150876 Aug 31 19:13:19.238969 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 73/155] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:19 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:19.240337 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-c3cc50fd-d3ed-41c8-81f9-abc6c0a990e1 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1322 microversion: 2.1 time: 0.148858 Aug 31 19:13:19.240897 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 83/156] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:19 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:13:19.541570 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-1c2e8ddf-c01d-4496-b4fc-8f51698e1d81 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:19.542278 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-1c2e8ddf-c01d-4496-b4fc-8f51698e1d81 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:19.548089 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1c2e8ddf-c01d-4496-b4fc-8f51698e1d81 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:19.548563 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1c2e8ddf-c01d-4496-b4fc-8f51698e1d81 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:19.548985 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1c2e8ddf-c01d-4496-b4fc-8f51698e1d81 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:19.549680 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1c2e8ddf-c01d-4496-b4fc-8f51698e1d81 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:19.550124 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1c2e8ddf-c01d-4496-b4fc-8f51698e1d81 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:19.550561 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1c2e8ddf-c01d-4496-b4fc-8f51698e1d81 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:19.684223 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1c2e8ddf-c01d-4496-b4fc-8f51698e1d81 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:19.691828 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-1c2e8ddf-c01d-4496-b4fc-8f51698e1d81 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1367 microversion: 2.1 time: 0.154706 Aug 31 19:13:19.692392 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 74/157] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:19 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:20.260269 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-47808742-a1b2-4a05-8fcc-42f9e7ddf73a tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:20.261274 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-b1d9723d-5577-4be7-bb72-c23a5532b7e0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:20.261691 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-47808742-a1b2-4a05-8fcc-42f9e7ddf73a tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:20.261879 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-b1d9723d-5577-4be7-bb72-c23a5532b7e0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:20.267746 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b1d9723d-5577-4be7-bb72-c23a5532b7e0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:20.267869 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-47808742-a1b2-4a05-8fcc-42f9e7ddf73a tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:20.268223 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b1d9723d-5577-4be7-bb72-c23a5532b7e0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:20.268333 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-47808742-a1b2-4a05-8fcc-42f9e7ddf73a tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:20.268650 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b1d9723d-5577-4be7-bb72-c23a5532b7e0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:20.268760 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-47808742-a1b2-4a05-8fcc-42f9e7ddf73a tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:20.269362 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b1d9723d-5577-4be7-bb72-c23a5532b7e0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:20.269485 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-47808742-a1b2-4a05-8fcc-42f9e7ddf73a tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:20.269814 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b1d9723d-5577-4be7-bb72-c23a5532b7e0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:20.269947 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-47808742-a1b2-4a05-8fcc-42f9e7ddf73a tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:20.270231 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b1d9723d-5577-4be7-bb72-c23a5532b7e0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:20.270330 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-47808742-a1b2-4a05-8fcc-42f9e7ddf73a tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:20.400906 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-47808742-a1b2-4a05-8fcc-42f9e7ddf73a tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:20.401757 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-b1d9723d-5577-4be7-bb72-c23a5532b7e0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:20.408653 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-47808742-a1b2-4a05-8fcc-42f9e7ddf73a tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1314 microversion: 2.1 time: 0.152860 Aug 31 19:13:20.409232 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 84/158] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:20 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:20.409395 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-b1d9723d-5577-4be7-bb72-c23a5532b7e0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1322 microversion: 2.1 time: 0.152357 Aug 31 19:13:20.409918 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 75/159] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:20 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:13:20.712595 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-fa66bbd4-0406-4c24-b26a-629ffcd29881 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:20.713201 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-fa66bbd4-0406-4c24-b26a-629ffcd29881 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:20.719058 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fa66bbd4-0406-4c24-b26a-629ffcd29881 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:20.719554 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fa66bbd4-0406-4c24-b26a-629ffcd29881 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:20.720005 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fa66bbd4-0406-4c24-b26a-629ffcd29881 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:20.720691 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fa66bbd4-0406-4c24-b26a-629ffcd29881 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:20.721131 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fa66bbd4-0406-4c24-b26a-629ffcd29881 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:20.721580 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fa66bbd4-0406-4c24-b26a-629ffcd29881 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:20.848791 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-fa66bbd4-0406-4c24-b26a-629ffcd29881 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:20.856985 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-fa66bbd4-0406-4c24-b26a-629ffcd29881 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1367 microversion: 2.1 time: 0.148838 Aug 31 19:13:20.857569 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 85/160] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:20 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:21.429720 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-81d79174-7637-443a-9a60-e0c2a97e69a6 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:21.430231 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-0d0ea3f8-ad79-4cdc-8051-0a80c0bb466c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:21.430591 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-81d79174-7637-443a-9a60-e0c2a97e69a6 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:21.431229 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-0d0ea3f8-ad79-4cdc-8051-0a80c0bb466c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:21.436805 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0d0ea3f8-ad79-4cdc-8051-0a80c0bb466c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:21.436951 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-81d79174-7637-443a-9a60-e0c2a97e69a6 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:21.437306 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0d0ea3f8-ad79-4cdc-8051-0a80c0bb466c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:21.437405 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-81d79174-7637-443a-9a60-e0c2a97e69a6 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:21.437731 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0d0ea3f8-ad79-4cdc-8051-0a80c0bb466c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:21.437835 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-81d79174-7637-443a-9a60-e0c2a97e69a6 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:21.438398 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0d0ea3f8-ad79-4cdc-8051-0a80c0bb466c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:21.438488 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-81d79174-7637-443a-9a60-e0c2a97e69a6 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:21.438840 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0d0ea3f8-ad79-4cdc-8051-0a80c0bb466c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:21.438929 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-81d79174-7637-443a-9a60-e0c2a97e69a6 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:21.439249 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0d0ea3f8-ad79-4cdc-8051-0a80c0bb466c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:21.439340 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-81d79174-7637-443a-9a60-e0c2a97e69a6 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:21.457729 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=100 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:13:21.576749 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-0d0ea3f8-ad79-4cdc-8051-0a80c0bb466c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:21.589494 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-0d0ea3f8-ad79-4cdc-8051-0a80c0bb466c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1322 microversion: 2.1 time: 0.163398 Aug 31 19:13:21.590250 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 86/161] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:21 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:13:21.596477 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-81d79174-7637-443a-9a60-e0c2a97e69a6 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:21.604062 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-81d79174-7637-443a-9a60-e0c2a97e69a6 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1314 microversion: 2.1 time: 0.178239 Aug 31 19:13:21.605022 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 76/162] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:21 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:21.878157 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-ed1eeb35-29ab-4318-bb19-5e75e118b187 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:21.878765 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-ed1eeb35-29ab-4318-bb19-5e75e118b187 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:21.884650 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ed1eeb35-29ab-4318-bb19-5e75e118b187 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:21.885129 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ed1eeb35-29ab-4318-bb19-5e75e118b187 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:21.885588 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ed1eeb35-29ab-4318-bb19-5e75e118b187 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:21.886274 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ed1eeb35-29ab-4318-bb19-5e75e118b187 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:21.886728 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ed1eeb35-29ab-4318-bb19-5e75e118b187 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:21.887148 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ed1eeb35-29ab-4318-bb19-5e75e118b187 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:22.014312 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-ed1eeb35-29ab-4318-bb19-5e75e118b187 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:22.022014 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-ed1eeb35-29ab-4318-bb19-5e75e118b187 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1367 microversion: 2.1 time: 0.147648 Aug 31 19:13:22.022903 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 87/163] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:21 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:22.611734 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-cd6e8fc1-8b76-4fab-bde0-0070de7433d7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:22.612370 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-cd6e8fc1-8b76-4fab-bde0-0070de7433d7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:22.619923 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cd6e8fc1-8b76-4fab-bde0-0070de7433d7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:22.620484 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cd6e8fc1-8b76-4fab-bde0-0070de7433d7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:22.621129 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cd6e8fc1-8b76-4fab-bde0-0070de7433d7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:22.621892 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cd6e8fc1-8b76-4fab-bde0-0070de7433d7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:22.622362 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cd6e8fc1-8b76-4fab-bde0-0070de7433d7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:22.623054 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cd6e8fc1-8b76-4fab-bde0-0070de7433d7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:22.628745 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-8a7a5b4a-aca8-4b43-936c-63d4d473a217 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:22.630942 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-8a7a5b4a-aca8-4b43-936c-63d4d473a217 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:22.637866 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8a7a5b4a-aca8-4b43-936c-63d4d473a217 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:22.638355 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8a7a5b4a-aca8-4b43-936c-63d4d473a217 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:22.638775 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8a7a5b4a-aca8-4b43-936c-63d4d473a217 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:22.639456 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8a7a5b4a-aca8-4b43-936c-63d4d473a217 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:22.639897 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8a7a5b4a-aca8-4b43-936c-63d4d473a217 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:22.640304 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8a7a5b4a-aca8-4b43-936c-63d4d473a217 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:22.771927 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-cd6e8fc1-8b76-4fab-bde0-0070de7433d7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:22.780409 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-cd6e8fc1-8b76-4fab-bde0-0070de7433d7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1322 microversion: 2.1 time: 0.172681 Aug 31 19:13:22.780970 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 77/164] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:22 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:22.784552 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-8a7a5b4a-aca8-4b43-936c-63d4d473a217 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:22.792212 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-8a7a5b4a-aca8-4b43-936c-63d4d473a217 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1314 microversion: 2.1 time: 0.168399 Aug 31 19:13:22.792769 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 88/165] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:22 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:23.043945 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e8791459-54cb-4cc9-9ac8-e2fce19a2662 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:23.044554 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-e8791459-54cb-4cc9-9ac8-e2fce19a2662 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:23.050492 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e8791459-54cb-4cc9-9ac8-e2fce19a2662 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:23.050975 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e8791459-54cb-4cc9-9ac8-e2fce19a2662 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:23.051405 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e8791459-54cb-4cc9-9ac8-e2fce19a2662 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:23.052085 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e8791459-54cb-4cc9-9ac8-e2fce19a2662 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:23.052536 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e8791459-54cb-4cc9-9ac8-e2fce19a2662 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:23.052961 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e8791459-54cb-4cc9-9ac8-e2fce19a2662 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:23.178152 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e8791459-54cb-4cc9-9ac8-e2fce19a2662 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:23.186281 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-e8791459-54cb-4cc9-9ac8-e2fce19a2662 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1367 microversion: 2.1 time: 0.146381 Aug 31 19:13:23.186843 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 78/166] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:23 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:23.800903 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-e78c729b-d42f-4d1d-955f-e15c738e9e2e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:23.802195 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-e78c729b-d42f-4d1d-955f-e15c738e9e2e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:23.813404 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-7237a13b-d49a-4291-b73d-805f21dd6231 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:23.814782 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-7237a13b-d49a-4291-b73d-805f21dd6231 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:23.823129 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e78c729b-d42f-4d1d-955f-e15c738e9e2e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:23.824720 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e78c729b-d42f-4d1d-955f-e15c738e9e2e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:23.826067 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7237a13b-d49a-4291-b73d-805f21dd6231 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:23.826614 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e78c729b-d42f-4d1d-955f-e15c738e9e2e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:23.827521 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e78c729b-d42f-4d1d-955f-e15c738e9e2e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:23.828066 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7237a13b-d49a-4291-b73d-805f21dd6231 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:23.830068 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7237a13b-d49a-4291-b73d-805f21dd6231 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:23.830068 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7237a13b-d49a-4291-b73d-805f21dd6231 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:23.830298 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e78c729b-d42f-4d1d-955f-e15c738e9e2e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:23.830730 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e78c729b-d42f-4d1d-955f-e15c738e9e2e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:23.833094 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7237a13b-d49a-4291-b73d-805f21dd6231 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:23.833656 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7237a13b-d49a-4291-b73d-805f21dd6231 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:23.994934 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-e78c729b-d42f-4d1d-955f-e15c738e9e2e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:24.005386 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-e78c729b-d42f-4d1d-955f-e15c738e9e2e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1322 microversion: 2.1 time: 0.209268 Aug 31 19:13:24.006463 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 89/167] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:23 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:24.019947 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-7237a13b-d49a-4291-b73d-805f21dd6231 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:24.028290 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-7237a13b-d49a-4291-b73d-805f21dd6231 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1314 microversion: 2.1 time: 0.219625 Aug 31 19:13:24.029039 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 79/168] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:23 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:24.207102 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-c867d947-8c8d-4193-bfc0-123c286f44a5 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:24.207701 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-c867d947-8c8d-4193-bfc0-123c286f44a5 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:24.213818 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c867d947-8c8d-4193-bfc0-123c286f44a5 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:24.214309 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c867d947-8c8d-4193-bfc0-123c286f44a5 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:24.214742 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c867d947-8c8d-4193-bfc0-123c286f44a5 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:24.215430 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c867d947-8c8d-4193-bfc0-123c286f44a5 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:24.216045 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c867d947-8c8d-4193-bfc0-123c286f44a5 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:24.216626 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c867d947-8c8d-4193-bfc0-123c286f44a5 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:24.359167 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-c867d947-8c8d-4193-bfc0-123c286f44a5 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:24.367009 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-c867d947-8c8d-4193-bfc0-123c286f44a5 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1367 microversion: 2.1 time: 0.163821 Aug 31 19:13:24.367568 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 90/169] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:24 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:25.027442 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-5d431034-43d0-407e-91ed-0a96f1d45f03 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:25.028041 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-5d431034-43d0-407e-91ed-0a96f1d45f03 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:25.034854 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5d431034-43d0-407e-91ed-0a96f1d45f03 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:25.035346 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5d431034-43d0-407e-91ed-0a96f1d45f03 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:25.035785 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5d431034-43d0-407e-91ed-0a96f1d45f03 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:25.036491 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5d431034-43d0-407e-91ed-0a96f1d45f03 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:25.036980 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5d431034-43d0-407e-91ed-0a96f1d45f03 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:25.037424 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5d431034-43d0-407e-91ed-0a96f1d45f03 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:25.055747 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-ad16ee2b-2822-4659-831f-b15b6818771a tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:25.056702 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-ad16ee2b-2822-4659-831f-b15b6818771a tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:25.065946 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ad16ee2b-2822-4659-831f-b15b6818771a tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:25.067597 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ad16ee2b-2822-4659-831f-b15b6818771a tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:25.079530 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ad16ee2b-2822-4659-831f-b15b6818771a tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:25.082238 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ad16ee2b-2822-4659-831f-b15b6818771a tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:25.083183 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ad16ee2b-2822-4659-831f-b15b6818771a tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:25.084025 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ad16ee2b-2822-4659-831f-b15b6818771a tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:25.227573 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-5d431034-43d0-407e-91ed-0a96f1d45f03 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:25.258296 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-5d431034-43d0-407e-91ed-0a96f1d45f03 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1322 microversion: 2.1 time: 0.235007 Aug 31 19:13:25.258943 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 80/170] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:25 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1322 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:25.280921 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-ad16ee2b-2822-4659-831f-b15b6818771a tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:25.288641 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-ad16ee2b-2822-4659-831f-b15b6818771a tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1314 microversion: 2.1 time: 0.237372 Aug 31 19:13:25.289274 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 91/171] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:25 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:13:25.388745 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-527e3936-0b64-4e8d-b012-8a6ac7adc7d9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:25.389503 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-527e3936-0b64-4e8d-b012-8a6ac7adc7d9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:25.396549 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-527e3936-0b64-4e8d-b012-8a6ac7adc7d9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:25.397975 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-527e3936-0b64-4e8d-b012-8a6ac7adc7d9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:25.398470 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-527e3936-0b64-4e8d-b012-8a6ac7adc7d9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:25.399345 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-527e3936-0b64-4e8d-b012-8a6ac7adc7d9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:25.400830 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-527e3936-0b64-4e8d-b012-8a6ac7adc7d9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:25.401447 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-527e3936-0b64-4e8d-b012-8a6ac7adc7d9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:25.540526 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-0f3dd849-0d87-46bd-9759-c304cfeb0b84 req-812900e6-c05e-4905-afe3-b81e5cfbb9b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28005e59-28f2-4e1e-a7d0-4ef68d9d6f48", "name": "network-vif-plugged", "status": "completed", "tag": "557704c0-c724-41a1-ae68-ae0c2d6b6bfd"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:13:25.549262 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-527e3936-0b64-4e8d-b012-8a6ac7adc7d9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:25.551399 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-0f3dd849-0d87-46bd-9759-c304cfeb0b84 req-812900e6-c05e-4905-afe3-b81e5cfbb9b9 service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:25.552788 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-0f3dd849-0d87-46bd-9759-c304cfeb0b84 req-812900e6-c05e-4905-afe3-b81e5cfbb9b9 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:25.553480 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-0f3dd849-0d87-46bd-9759-c304cfeb0b84 req-812900e6-c05e-4905-afe3-b81e5cfbb9b9 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:25.558995 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-527e3936-0b64-4e8d-b012-8a6ac7adc7d9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1367 microversion: 2.1 time: 0.175267 Aug 31 19:13:25.572160 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 81/172] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:25 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:25.572376 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-0f3dd849-0d87-46bd-9759-c304cfeb0b84 req-812900e6-c05e-4905-afe3-b81e5cfbb9b9 service nova] Creating event network-vif-plugged:557704c0-c724-41a1-ae68-ae0c2d6b6bfd for instance 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 on hv-cinder-83538 Aug 31 19:13:25.573643 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-0f3dd849-0d87-46bd-9759-c304cfeb0b84 req-812900e6-c05e-4905-afe3-b81e5cfbb9b9 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037284 Aug 31 19:13:25.574387 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 92/173] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:13:26.282079 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-0263f01a-9c4f-40ef-913c-79e71d3c04fd tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:26.284167 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-0263f01a-9c4f-40ef-913c-79e71d3c04fd tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:26.294147 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0263f01a-9c4f-40ef-913c-79e71d3c04fd tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:26.295225 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0263f01a-9c4f-40ef-913c-79e71d3c04fd tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:26.296072 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0263f01a-9c4f-40ef-913c-79e71d3c04fd tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:26.298909 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0263f01a-9c4f-40ef-913c-79e71d3c04fd tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:26.299942 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0263f01a-9c4f-40ef-913c-79e71d3c04fd tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:26.300649 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0263f01a-9c4f-40ef-913c-79e71d3c04fd tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:26.313475 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-3b5e9083-0c1c-4a7c-a162-3b10271d412c tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:26.314465 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-3b5e9083-0c1c-4a7c-a162-3b10271d412c tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:26.343623 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3b5e9083-0c1c-4a7c-a162-3b10271d412c tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:26.344163 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3b5e9083-0c1c-4a7c-a162-3b10271d412c tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:26.344591 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3b5e9083-0c1c-4a7c-a162-3b10271d412c tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:26.345340 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3b5e9083-0c1c-4a7c-a162-3b10271d412c tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:26.345788 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3b5e9083-0c1c-4a7c-a162-3b10271d412c tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:26.346210 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3b5e9083-0c1c-4a7c-a162-3b10271d412c tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:26.547879 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-3b5e9083-0c1c-4a7c-a162-3b10271d412c tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:26.557868 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-3b5e9083-0c1c-4a7c-a162-3b10271d412c tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1314 microversion: 2.1 time: 0.251339 Aug 31 19:13:26.559829 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 93/174] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:26 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:26.580394 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-9607e400-8db0-4db7-93d5-eab2c383cd05 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:26.581274 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-9607e400-8db0-4db7-93d5-eab2c383cd05 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:26.591249 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9607e400-8db0-4db7-93d5-eab2c383cd05 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:26.591676 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9607e400-8db0-4db7-93d5-eab2c383cd05 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:26.593562 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9607e400-8db0-4db7-93d5-eab2c383cd05 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:26.594290 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9607e400-8db0-4db7-93d5-eab2c383cd05 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:26.594748 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9607e400-8db0-4db7-93d5-eab2c383cd05 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:26.595165 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9607e400-8db0-4db7-93d5-eab2c383cd05 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:26.662511 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-0263f01a-9c4f-40ef-913c-79e71d3c04fd tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:26.670972 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-0263f01a-9c4f-40ef-913c-79e71d3c04fd tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1322 microversion: 2.1 time: 0.395983 Aug 31 19:13:26.671544 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 82/175] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:26 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1322 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:26.775117 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-9607e400-8db0-4db7-93d5-eab2c383cd05 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:26.782900 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-9607e400-8db0-4db7-93d5-eab2c383cd05 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1367 microversion: 2.1 time: 0.207052 Aug 31 19:13:26.783466 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 94/176] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:26 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1367 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:27.578550 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-c23a0fb2-4652-4c56-bfd3-e70e8911e567 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:27.579151 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-c23a0fb2-4652-4c56-bfd3-e70e8911e567 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:27.584999 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c23a0fb2-4652-4c56-bfd3-e70e8911e567 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:27.585508 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c23a0fb2-4652-4c56-bfd3-e70e8911e567 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:27.585938 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c23a0fb2-4652-4c56-bfd3-e70e8911e567 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:27.586615 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c23a0fb2-4652-4c56-bfd3-e70e8911e567 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:27.587062 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c23a0fb2-4652-4c56-bfd3-e70e8911e567 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:27.588020 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c23a0fb2-4652-4c56-bfd3-e70e8911e567 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:27.695274 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-bab0a93a-b2ee-4d5b-9dad-9d2a6582d908 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:27.696023 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-bab0a93a-b2ee-4d5b-9dad-9d2a6582d908 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:27.703369 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bab0a93a-b2ee-4d5b-9dad-9d2a6582d908 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:27.704133 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bab0a93a-b2ee-4d5b-9dad-9d2a6582d908 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:27.704730 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bab0a93a-b2ee-4d5b-9dad-9d2a6582d908 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:27.705642 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bab0a93a-b2ee-4d5b-9dad-9d2a6582d908 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:27.706088 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bab0a93a-b2ee-4d5b-9dad-9d2a6582d908 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:27.706509 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bab0a93a-b2ee-4d5b-9dad-9d2a6582d908 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:27.778482 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-c23a0fb2-4652-4c56-bfd3-e70e8911e567 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:27.788112 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-c23a0fb2-4652-4c56-bfd3-e70e8911e567 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1314 microversion: 2.1 time: 0.213380 Aug 31 19:13:27.788784 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 83/177] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:27 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:27.804901 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-b2af67a1-a04d-4236-8d56-dbe48c7b70a3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:27.805473 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-b2af67a1-a04d-4236-8d56-dbe48c7b70a3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:27.815541 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b2af67a1-a04d-4236-8d56-dbe48c7b70a3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:27.816200 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b2af67a1-a04d-4236-8d56-dbe48c7b70a3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:27.816644 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b2af67a1-a04d-4236-8d56-dbe48c7b70a3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:27.817375 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b2af67a1-a04d-4236-8d56-dbe48c7b70a3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:27.817827 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b2af67a1-a04d-4236-8d56-dbe48c7b70a3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:27.818250 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b2af67a1-a04d-4236-8d56-dbe48c7b70a3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:27.877132 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-bab0a93a-b2ee-4d5b-9dad-9d2a6582d908 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:27.885590 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-bab0a93a-b2ee-4d5b-9dad-9d2a6582d908 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1322 microversion: 2.1 time: 0.194033 Aug 31 19:13:27.886170 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 95/178] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:27 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1322 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:13:27.948719 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-b2af67a1-a04d-4236-8d56-dbe48c7b70a3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:27.956627 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-b2af67a1-a04d-4236-8d56-dbe48c7b70a3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1367 microversion: 2.1 time: 0.156511 Aug 31 19:13:27.957655 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 84/179] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:27 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:13:28.809313 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-4936ba90-5ea6-4106-a803-2684167c06cc tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:28.810057 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-4936ba90-5ea6-4106-a803-2684167c06cc tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:28.816761 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4936ba90-5ea6-4106-a803-2684167c06cc tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:28.817461 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4936ba90-5ea6-4106-a803-2684167c06cc tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:28.817989 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4936ba90-5ea6-4106-a803-2684167c06cc tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:28.818801 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4936ba90-5ea6-4106-a803-2684167c06cc tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:28.819352 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4936ba90-5ea6-4106-a803-2684167c06cc tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:28.819953 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4936ba90-5ea6-4106-a803-2684167c06cc tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:28.907639 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-b9325591-14d4-4cd0-98d0-3a58e512be2d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:28.908333 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-b9325591-14d4-4cd0-98d0-3a58e512be2d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:28.914915 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b9325591-14d4-4cd0-98d0-3a58e512be2d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:28.916323 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b9325591-14d4-4cd0-98d0-3a58e512be2d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:28.916814 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b9325591-14d4-4cd0-98d0-3a58e512be2d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:28.918581 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b9325591-14d4-4cd0-98d0-3a58e512be2d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:28.919398 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b9325591-14d4-4cd0-98d0-3a58e512be2d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:28.920007 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b9325591-14d4-4cd0-98d0-3a58e512be2d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:29.008654 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-4936ba90-5ea6-4106-a803-2684167c06cc tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:29.021653 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-4936ba90-5ea6-4106-a803-2684167c06cc tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1314 microversion: 2.1 time: 0.216634 Aug 31 19:13:29.027336 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 96/180] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:28 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:29.033137 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-aa5593b3-5c7e-415d-927c-165c5d27acdb tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:29.035318 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-aa5593b3-5c7e-415d-927c-165c5d27acdb tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:29.047570 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-aa5593b3-5c7e-415d-927c-165c5d27acdb tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:29.049257 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-aa5593b3-5c7e-415d-927c-165c5d27acdb tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:29.051387 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-aa5593b3-5c7e-415d-927c-165c5d27acdb tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:29.054759 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-aa5593b3-5c7e-415d-927c-165c5d27acdb tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:29.057002 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-aa5593b3-5c7e-415d-927c-165c5d27acdb tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:29.061696 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-aa5593b3-5c7e-415d-927c-165c5d27acdb tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:29.144720 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-b9325591-14d4-4cd0-98d0-3a58e512be2d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:29.156007 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-b9325591-14d4-4cd0-98d0-3a58e512be2d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1322 microversion: 2.1 time: 0.252679 Aug 31 19:13:29.162318 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 85/181] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:28 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1322 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:29.265446 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-aa5593b3-5c7e-415d-927c-165c5d27acdb tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:29.273439 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-aa5593b3-5c7e-415d-927c-165c5d27acdb tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1367 microversion: 2.1 time: 0.244459 Aug 31 19:13:29.274004 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 97/182] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:29 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1367 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:30.050822 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-bb16eebe-13f2-4575-b96a-24919a5f6263 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:30.051361 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-bb16eebe-13f2-4575-b96a-24919a5f6263 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:30.057430 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bb16eebe-13f2-4575-b96a-24919a5f6263 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:30.057921 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bb16eebe-13f2-4575-b96a-24919a5f6263 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:30.058362 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bb16eebe-13f2-4575-b96a-24919a5f6263 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:30.059055 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bb16eebe-13f2-4575-b96a-24919a5f6263 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:30.059509 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bb16eebe-13f2-4575-b96a-24919a5f6263 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:30.059929 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bb16eebe-13f2-4575-b96a-24919a5f6263 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:30.176032 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-0870f1ba-5301-4529-b572-b9fd515c86e4 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:30.177220 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-0870f1ba-5301-4529-b572-b9fd515c86e4 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:30.183264 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0870f1ba-5301-4529-b572-b9fd515c86e4 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:30.183750 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0870f1ba-5301-4529-b572-b9fd515c86e4 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:30.184183 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0870f1ba-5301-4529-b572-b9fd515c86e4 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:30.184875 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0870f1ba-5301-4529-b572-b9fd515c86e4 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:30.185359 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0870f1ba-5301-4529-b572-b9fd515c86e4 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:30.185787 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0870f1ba-5301-4529-b572-b9fd515c86e4 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:30.236921 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-bb16eebe-13f2-4575-b96a-24919a5f6263 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:30.246703 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-bb16eebe-13f2-4575-b96a-24919a5f6263 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1314 microversion: 2.1 time: 0.199700 Aug 31 19:13:30.247254 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 86/183] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:30 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:30.294361 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e6691875-b58e-40c5-9a5b-ad01d65b1e90 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:30.295190 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-e6691875-b58e-40c5-9a5b-ad01d65b1e90 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:30.308343 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e6691875-b58e-40c5-9a5b-ad01d65b1e90 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:30.308865 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e6691875-b58e-40c5-9a5b-ad01d65b1e90 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:30.312598 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e6691875-b58e-40c5-9a5b-ad01d65b1e90 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:30.313718 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e6691875-b58e-40c5-9a5b-ad01d65b1e90 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:30.314236 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e6691875-b58e-40c5-9a5b-ad01d65b1e90 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:30.314741 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e6691875-b58e-40c5-9a5b-ad01d65b1e90 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:30.342694 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-0870f1ba-5301-4529-b572-b9fd515c86e4 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:30.351125 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-0870f1ba-5301-4529-b572-b9fd515c86e4 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1322 microversion: 2.1 time: 0.179136 Aug 31 19:13:30.364534 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 98/184] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:30 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:13:30.481514 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e6691875-b58e-40c5-9a5b-ad01d65b1e90 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:30.491797 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-e6691875-b58e-40c5-9a5b-ad01d65b1e90 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1367 microversion: 2.1 time: 0.201534 Aug 31 19:13:30.492800 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 87/185] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:30 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1367 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:13:30.521203 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-ecaa8cbf-6701-47a5-acba-a835bb98201e req-7a20347e-a746-43fd-964f-52c7726cee6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88b9d0d7-01c7-4a08-9a15-a20bd1db6019", "name": "network-vif-plugged", "status": "completed", "tag": "1822743f-00a6-44c7-b33e-1c7130689b42"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:13:30.530946 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-ecaa8cbf-6701-47a5-acba-a835bb98201e req-7a20347e-a746-43fd-964f-52c7726cee6b service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:30.531412 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-ecaa8cbf-6701-47a5-acba-a835bb98201e req-7a20347e-a746-43fd-964f-52c7726cee6b service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:30.531998 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-ecaa8cbf-6701-47a5-acba-a835bb98201e req-7a20347e-a746-43fd-964f-52c7726cee6b service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:30.546530 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-ecaa8cbf-6701-47a5-acba-a835bb98201e req-7a20347e-a746-43fd-964f-52c7726cee6b service nova] Creating event network-vif-plugged:1822743f-00a6-44c7-b33e-1c7130689b42 for instance 88b9d0d7-01c7-4a08-9a15-a20bd1db6019 on hv-cinder-83538 Aug 31 19:13:30.552478 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-ecaa8cbf-6701-47a5-acba-a835bb98201e req-7a20347e-a746-43fd-964f-52c7726cee6b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034633 Aug 31 19:13:30.553084 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 99/186] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:13:31.267708 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-4e8720bd-1a14-4db7-8fbf-ca6ff6e9b312 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:31.268581 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-4e8720bd-1a14-4db7-8fbf-ca6ff6e9b312 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:31.276631 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4e8720bd-1a14-4db7-8fbf-ca6ff6e9b312 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:31.277201 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4e8720bd-1a14-4db7-8fbf-ca6ff6e9b312 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:31.277652 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4e8720bd-1a14-4db7-8fbf-ca6ff6e9b312 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:31.278341 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4e8720bd-1a14-4db7-8fbf-ca6ff6e9b312 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:31.278793 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4e8720bd-1a14-4db7-8fbf-ca6ff6e9b312 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:31.279212 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4e8720bd-1a14-4db7-8fbf-ca6ff6e9b312 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:31.372561 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-b5972a9a-c6e3-4ebc-983f-1d4e824f519b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:31.373341 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-b5972a9a-c6e3-4ebc-983f-1d4e824f519b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:31.384830 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b5972a9a-c6e3-4ebc-983f-1d4e824f519b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:31.385353 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b5972a9a-c6e3-4ebc-983f-1d4e824f519b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:31.385788 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b5972a9a-c6e3-4ebc-983f-1d4e824f519b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:31.386499 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b5972a9a-c6e3-4ebc-983f-1d4e824f519b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:31.386994 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b5972a9a-c6e3-4ebc-983f-1d4e824f519b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:31.387415 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b5972a9a-c6e3-4ebc-983f-1d4e824f519b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:31.429657 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-4e8720bd-1a14-4db7-8fbf-ca6ff6e9b312 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:31.437367 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-4e8720bd-1a14-4db7-8fbf-ca6ff6e9b312 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1314 microversion: 2.1 time: 0.173344 Aug 31 19:13:31.442767 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 88/187] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:31 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:31.515455 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-48988d52-828e-49b5-b410-10efc3aa5aa1 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:31.517396 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-48988d52-828e-49b5-b410-10efc3aa5aa1 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:31.525913 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-48988d52-828e-49b5-b410-10efc3aa5aa1 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:31.526770 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-48988d52-828e-49b5-b410-10efc3aa5aa1 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:31.527476 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-48988d52-828e-49b5-b410-10efc3aa5aa1 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:31.528418 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-48988d52-828e-49b5-b410-10efc3aa5aa1 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:31.529023 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-48988d52-828e-49b5-b410-10efc3aa5aa1 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:31.529478 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-48988d52-828e-49b5-b410-10efc3aa5aa1 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:31.566220 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-b5972a9a-c6e3-4ebc-983f-1d4e824f519b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:31.576249 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-b5972a9a-c6e3-4ebc-983f-1d4e824f519b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1322 microversion: 2.1 time: 0.207985 Aug 31 19:13:31.576813 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 100/188] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:31 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:13:31.719903 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-48988d52-828e-49b5-b410-10efc3aa5aa1 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:31.728646 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-48988d52-828e-49b5-b410-10efc3aa5aa1 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1367 microversion: 2.1 time: 0.218472 Aug 31 19:13:31.730140 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 89/189] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:31 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:32.466142 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-f1bca1bb-aabf-4361-ab89-c4dfe1f61fc3 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:32.466975 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-f1bca1bb-aabf-4361-ab89-c4dfe1f61fc3 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:32.472843 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f1bca1bb-aabf-4361-ab89-c4dfe1f61fc3 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:32.473501 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f1bca1bb-aabf-4361-ab89-c4dfe1f61fc3 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:32.474025 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f1bca1bb-aabf-4361-ab89-c4dfe1f61fc3 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:32.474900 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f1bca1bb-aabf-4361-ab89-c4dfe1f61fc3 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:32.475410 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f1bca1bb-aabf-4361-ab89-c4dfe1f61fc3 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:32.475820 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f1bca1bb-aabf-4361-ab89-c4dfe1f61fc3 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:32.597346 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-779ac747-fca7-4418-9867-19f409d002f2 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:32.597950 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-779ac747-fca7-4418-9867-19f409d002f2 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:32.604536 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-779ac747-fca7-4418-9867-19f409d002f2 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:32.605015 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-779ac747-fca7-4418-9867-19f409d002f2 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:32.605641 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-779ac747-fca7-4418-9867-19f409d002f2 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:32.606214 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-f1bca1bb-aabf-4361-ab89-c4dfe1f61fc3 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:32.606432 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-779ac747-fca7-4418-9867-19f409d002f2 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:32.606881 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-779ac747-fca7-4418-9867-19f409d002f2 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:32.607299 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-779ac747-fca7-4418-9867-19f409d002f2 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:32.610006 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=100 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:13:32.615175 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-f1bca1bb-aabf-4361-ab89-c4dfe1f61fc3 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1314 microversion: 2.1 time: 0.153125 Aug 31 19:13:32.615807 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 101/190] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:32 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:32.734613 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-779ac747-fca7-4418-9867-19f409d002f2 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:32.742530 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-779ac747-fca7-4418-9867-19f409d002f2 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1322 microversion: 2.1 time: 0.149039 Aug 31 19:13:32.743224 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 90/191] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:32 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:32.749456 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-68b11294-99de-4ddb-90b6-b95f5c367ee9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:32.750186 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-68b11294-99de-4ddb-90b6-b95f5c367ee9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:32.756310 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-68b11294-99de-4ddb-90b6-b95f5c367ee9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:32.756851 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-68b11294-99de-4ddb-90b6-b95f5c367ee9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:32.757371 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-68b11294-99de-4ddb-90b6-b95f5c367ee9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:32.758118 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-68b11294-99de-4ddb-90b6-b95f5c367ee9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:32.758626 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-68b11294-99de-4ddb-90b6-b95f5c367ee9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:32.759155 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-68b11294-99de-4ddb-90b6-b95f5c367ee9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:32.888323 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-68b11294-99de-4ddb-90b6-b95f5c367ee9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:32.896010 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-68b11294-99de-4ddb-90b6-b95f5c367ee9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1367 microversion: 2.1 time: 0.150442 Aug 31 19:13:32.896562 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 102/192] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:32 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:33.637477 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-0db06f51-7dc0-4200-80d6-40bc563c1077 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:33.638103 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-0db06f51-7dc0-4200-80d6-40bc563c1077 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:33.649719 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0db06f51-7dc0-4200-80d6-40bc563c1077 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:33.649719 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0db06f51-7dc0-4200-80d6-40bc563c1077 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:33.649719 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0db06f51-7dc0-4200-80d6-40bc563c1077 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:33.649719 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0db06f51-7dc0-4200-80d6-40bc563c1077 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:33.650060 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0db06f51-7dc0-4200-80d6-40bc563c1077 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:33.650060 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0db06f51-7dc0-4200-80d6-40bc563c1077 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:33.762909 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-effa0dc4-2952-466d-8b70-08579acd6135 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:33.763601 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-effa0dc4-2952-466d-8b70-08579acd6135 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:33.769682 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-effa0dc4-2952-466d-8b70-08579acd6135 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:33.770241 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-effa0dc4-2952-466d-8b70-08579acd6135 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:33.770741 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-effa0dc4-2952-466d-8b70-08579acd6135 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:33.771497 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-effa0dc4-2952-466d-8b70-08579acd6135 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:33.772038 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-effa0dc4-2952-466d-8b70-08579acd6135 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:33.772542 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-effa0dc4-2952-466d-8b70-08579acd6135 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:33.780906 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-0db06f51-7dc0-4200-80d6-40bc563c1077 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:33.788694 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-0db06f51-7dc0-4200-80d6-40bc563c1077 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1314 microversion: 2.1 time: 0.156724 Aug 31 19:13:33.791424 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 91/193] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:33 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:33.898511 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-effa0dc4-2952-466d-8b70-08579acd6135 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:33.906111 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-effa0dc4-2952-466d-8b70-08579acd6135 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1322 microversion: 2.1 time: 0.147136 Aug 31 19:13:33.906679 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 103/194] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:33 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:13:33.917905 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-9733fe24-167a-4bdc-b345-6f5e69da09c1 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:33.918595 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-9733fe24-167a-4bdc-b345-6f5e69da09c1 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:33.924683 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9733fe24-167a-4bdc-b345-6f5e69da09c1 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:33.925162 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9733fe24-167a-4bdc-b345-6f5e69da09c1 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:33.925629 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9733fe24-167a-4bdc-b345-6f5e69da09c1 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:33.926311 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9733fe24-167a-4bdc-b345-6f5e69da09c1 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:33.926761 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9733fe24-167a-4bdc-b345-6f5e69da09c1 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:33.927179 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9733fe24-167a-4bdc-b345-6f5e69da09c1 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:34.054310 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-9733fe24-167a-4bdc-b345-6f5e69da09c1 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:34.062534 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-9733fe24-167a-4bdc-b345-6f5e69da09c1 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1367 microversion: 2.1 time: 0.149029 Aug 31 19:13:34.063092 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 92/195] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:33 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:34.811007 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-643d276c-50c2-4c6e-9e28-e10b06818053 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:34.811618 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-643d276c-50c2-4c6e-9e28-e10b06818053 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:34.817570 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-643d276c-50c2-4c6e-9e28-e10b06818053 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:34.818056 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-643d276c-50c2-4c6e-9e28-e10b06818053 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:34.818491 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-643d276c-50c2-4c6e-9e28-e10b06818053 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:34.819180 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-643d276c-50c2-4c6e-9e28-e10b06818053 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:34.819632 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-643d276c-50c2-4c6e-9e28-e10b06818053 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:34.820057 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-643d276c-50c2-4c6e-9e28-e10b06818053 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:34.927091 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-23c8af67-e558-40b2-964b-e50b28c609d0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:34.927751 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-23c8af67-e558-40b2-964b-e50b28c609d0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:34.933955 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-23c8af67-e558-40b2-964b-e50b28c609d0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:34.934664 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-23c8af67-e558-40b2-964b-e50b28c609d0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:34.935249 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-23c8af67-e558-40b2-964b-e50b28c609d0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:34.936482 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-23c8af67-e558-40b2-964b-e50b28c609d0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:34.937267 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-23c8af67-e558-40b2-964b-e50b28c609d0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:34.937685 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-23c8af67-e558-40b2-964b-e50b28c609d0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:34.941836 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=100 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:13:34.969774 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-643d276c-50c2-4c6e-9e28-e10b06818053 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:34.979540 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-643d276c-50c2-4c6e-9e28-e10b06818053 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1314 microversion: 2.1 time: 0.172074 Aug 31 19:13:34.981228 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 104/196] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:34 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:35.072118 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-23c8af67-e558-40b2-964b-e50b28c609d0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:35.080555 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-23c8af67-e558-40b2-964b-e50b28c609d0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1322 microversion: 2.1 time: 0.157755 Aug 31 19:13:35.081119 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 93/197] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:34 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:13:35.084925 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-3195572b-8304-483f-b567-ea950577654f tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:35.085647 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-3195572b-8304-483f-b567-ea950577654f tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:35.092533 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3195572b-8304-483f-b567-ea950577654f tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:35.093006 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3195572b-8304-483f-b567-ea950577654f tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:35.093630 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3195572b-8304-483f-b567-ea950577654f tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:35.094400 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3195572b-8304-483f-b567-ea950577654f tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:35.094908 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3195572b-8304-483f-b567-ea950577654f tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:35.095336 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3195572b-8304-483f-b567-ea950577654f tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:35.239715 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-3195572b-8304-483f-b567-ea950577654f tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:35.248467 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-3195572b-8304-483f-b567-ea950577654f tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1367 microversion: 2.1 time: 0.168487 Aug 31 19:13:35.249348 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 105/198] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:35 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:13:35.999514 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-4809f00a-c321-426a-bf1e-d48d786f57db tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:36.000121 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-4809f00a-c321-426a-bf1e-d48d786f57db tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:36.005969 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4809f00a-c321-426a-bf1e-d48d786f57db tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:36.006450 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4809f00a-c321-426a-bf1e-d48d786f57db tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:36.006884 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4809f00a-c321-426a-bf1e-d48d786f57db tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:36.007571 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4809f00a-c321-426a-bf1e-d48d786f57db tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:36.008022 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4809f00a-c321-426a-bf1e-d48d786f57db tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:36.008438 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4809f00a-c321-426a-bf1e-d48d786f57db tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:36.103897 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-52e29a7b-e31e-44f1-b9b3-081831f646d7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:36.105966 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-52e29a7b-e31e-44f1-b9b3-081831f646d7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:36.114653 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-52e29a7b-e31e-44f1-b9b3-081831f646d7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:36.116498 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-52e29a7b-e31e-44f1-b9b3-081831f646d7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:36.117414 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-52e29a7b-e31e-44f1-b9b3-081831f646d7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:36.118835 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-52e29a7b-e31e-44f1-b9b3-081831f646d7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:36.119595 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-52e29a7b-e31e-44f1-b9b3-081831f646d7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:36.120340 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-52e29a7b-e31e-44f1-b9b3-081831f646d7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:36.154016 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-4809f00a-c321-426a-bf1e-d48d786f57db tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:36.162995 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-4809f00a-c321-426a-bf1e-d48d786f57db tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1314 microversion: 2.1 time: 0.167135 Aug 31 19:13:36.164015 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 94/199] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:35 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:36.270010 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-0774ee8b-7965-4189-8ca1-13f16c92eb8c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:36.270746 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-0774ee8b-7965-4189-8ca1-13f16c92eb8c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:36.277492 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0774ee8b-7965-4189-8ca1-13f16c92eb8c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:36.278071 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0774ee8b-7965-4189-8ca1-13f16c92eb8c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:36.278592 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0774ee8b-7965-4189-8ca1-13f16c92eb8c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:36.279277 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0774ee8b-7965-4189-8ca1-13f16c92eb8c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:36.279720 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0774ee8b-7965-4189-8ca1-13f16c92eb8c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:36.280127 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0774ee8b-7965-4189-8ca1-13f16c92eb8c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:36.313781 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-52e29a7b-e31e-44f1-b9b3-081831f646d7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:36.323716 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-52e29a7b-e31e-44f1-b9b3-081831f646d7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1322 microversion: 2.1 time: 0.226192 Aug 31 19:13:36.333957 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 106/200] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:36 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:13:36.417819 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-0774ee8b-7965-4189-8ca1-13f16c92eb8c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:36.425707 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-0774ee8b-7965-4189-8ca1-13f16c92eb8c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1367 microversion: 2.1 time: 0.159697 Aug 31 19:13:36.426281 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 95/201] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:36 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:13:37.183764 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-2e259200-7f78-4cc9-86b8-fe384e5f4a27 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:37.184493 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-2e259200-7f78-4cc9-86b8-fe384e5f4a27 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:37.190745 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2e259200-7f78-4cc9-86b8-fe384e5f4a27 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:37.191344 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2e259200-7f78-4cc9-86b8-fe384e5f4a27 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:37.192010 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2e259200-7f78-4cc9-86b8-fe384e5f4a27 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:37.192779 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2e259200-7f78-4cc9-86b8-fe384e5f4a27 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:37.193350 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2e259200-7f78-4cc9-86b8-fe384e5f4a27 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:37.193842 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2e259200-7f78-4cc9-86b8-fe384e5f4a27 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:37.337683 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-2e259200-7f78-4cc9-86b8-fe384e5f4a27 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:37.346419 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-2e259200-7f78-4cc9-86b8-fe384e5f4a27 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1314 microversion: 2.1 time: 0.166330 Aug 31 19:13:37.346932 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d1fa9131-5fcb-4fc5-b262-77f04cbcf7f6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:37.347418 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 107/202] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:37 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:37.348600 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d1fa9131-5fcb-4fc5-b262-77f04cbcf7f6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:37.351385 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=80 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:13:37.357324 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d1fa9131-5fcb-4fc5-b262-77f04cbcf7f6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:37.358278 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d1fa9131-5fcb-4fc5-b262-77f04cbcf7f6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:37.359079 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d1fa9131-5fcb-4fc5-b262-77f04cbcf7f6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:37.359785 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d1fa9131-5fcb-4fc5-b262-77f04cbcf7f6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:37.360240 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d1fa9131-5fcb-4fc5-b262-77f04cbcf7f6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:37.360656 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d1fa9131-5fcb-4fc5-b262-77f04cbcf7f6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:37.447852 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-862ccd69-0c01-4b54-b355-96ea99dfc478 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:37.448608 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-862ccd69-0c01-4b54-b355-96ea99dfc478 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:37.455195 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-862ccd69-0c01-4b54-b355-96ea99dfc478 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:37.455712 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-862ccd69-0c01-4b54-b355-96ea99dfc478 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:37.456121 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-862ccd69-0c01-4b54-b355-96ea99dfc478 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:37.456856 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-862ccd69-0c01-4b54-b355-96ea99dfc478 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:37.457393 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-862ccd69-0c01-4b54-b355-96ea99dfc478 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:37.457819 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-862ccd69-0c01-4b54-b355-96ea99dfc478 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:37.589326 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-d1fa9131-5fcb-4fc5-b262-77f04cbcf7f6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:37.599094 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-d1fa9131-5fcb-4fc5-b262-77f04cbcf7f6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1322 microversion: 2.1 time: 0.256368 Aug 31 19:13:37.613462 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 96/203] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:37 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1322 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:13:37.674673 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-862ccd69-0c01-4b54-b355-96ea99dfc478 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:37.682490 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-862ccd69-0c01-4b54-b355-96ea99dfc478 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1367 microversion: 2.1 time: 0.239446 Aug 31 19:13:37.683216 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 108/204] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:37 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:13:38.367687 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-cb01ac2e-547e-40ad-bed8-cb9471c9b33a tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:38.368465 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-cb01ac2e-547e-40ad-bed8-cb9471c9b33a tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:38.374920 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cb01ac2e-547e-40ad-bed8-cb9471c9b33a tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:38.375408 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cb01ac2e-547e-40ad-bed8-cb9471c9b33a tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:38.375840 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cb01ac2e-547e-40ad-bed8-cb9471c9b33a tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:38.376532 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cb01ac2e-547e-40ad-bed8-cb9471c9b33a tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:38.376982 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cb01ac2e-547e-40ad-bed8-cb9471c9b33a tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:38.377429 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cb01ac2e-547e-40ad-bed8-cb9471c9b33a tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:38.620443 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-ab67f579-6137-4598-ac31-80a5ad91ab3d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:38.621052 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-ab67f579-6137-4598-ac31-80a5ad91ab3d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:38.630157 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ab67f579-6137-4598-ac31-80a5ad91ab3d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:38.630266 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ab67f579-6137-4598-ac31-80a5ad91ab3d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:38.630658 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ab67f579-6137-4598-ac31-80a5ad91ab3d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:38.631382 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ab67f579-6137-4598-ac31-80a5ad91ab3d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:38.631815 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ab67f579-6137-4598-ac31-80a5ad91ab3d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:38.632240 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ab67f579-6137-4598-ac31-80a5ad91ab3d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:38.830755 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-cb01ac2e-547e-40ad-bed8-cb9471c9b33a tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:38.845894 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-cb01ac2e-547e-40ad-bed8-cb9471c9b33a tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1314 microversion: 2.1 time: 0.481798 Aug 31 19:13:38.847677 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 97/205] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:38 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1314 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:38.873266 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-6c2cb51a-31bc-4be5-94ad-110990a2c069 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:38.873889 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-6c2cb51a-31bc-4be5-94ad-110990a2c069 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:38.879987 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6c2cb51a-31bc-4be5-94ad-110990a2c069 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:38.880478 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6c2cb51a-31bc-4be5-94ad-110990a2c069 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:38.880945 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6c2cb51a-31bc-4be5-94ad-110990a2c069 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:38.881726 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6c2cb51a-31bc-4be5-94ad-110990a2c069 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:38.882184 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6c2cb51a-31bc-4be5-94ad-110990a2c069 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:38.883119 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6c2cb51a-31bc-4be5-94ad-110990a2c069 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:38.905903 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-ab67f579-6137-4598-ac31-80a5ad91ab3d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:38.921244 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-ab67f579-6137-4598-ac31-80a5ad91ab3d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1322 microversion: 2.1 time: 0.303054 Aug 31 19:13:38.923158 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 109/206] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:38 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1322 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:13:38.936064 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-fb3d67dd-7c86-4c48-b498-dc7e4b1df697 req-6cd25b1f-ebb5-4a00-9706-47d8b6b506e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9141c1ef-36d3-4d8c-bd46-8045891fe3c2", "name": "network-vif-plugged", "status": "completed", "tag": "54772a5e-157f-44ed-b49a-99e7be75af5e"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:13:38.946428 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-fb3d67dd-7c86-4c48-b498-dc7e4b1df697 req-6cd25b1f-ebb5-4a00-9706-47d8b6b506e9 service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:38.947172 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-fb3d67dd-7c86-4c48-b498-dc7e4b1df697 req-6cd25b1f-ebb5-4a00-9706-47d8b6b506e9 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:38.947764 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-fb3d67dd-7c86-4c48-b498-dc7e4b1df697 req-6cd25b1f-ebb5-4a00-9706-47d8b6b506e9 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:38.962244 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-fb3d67dd-7c86-4c48-b498-dc7e4b1df697 req-6cd25b1f-ebb5-4a00-9706-47d8b6b506e9 service nova] Creating event network-vif-plugged:54772a5e-157f-44ed-b49a-99e7be75af5e for instance 9141c1ef-36d3-4d8c-bd46-8045891fe3c2 on hv-cinder-83538 Aug 31 19:13:38.978212 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-fb3d67dd-7c86-4c48-b498-dc7e4b1df697 req-6cd25b1f-ebb5-4a00-9706-47d8b6b506e9 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052047 Aug 31 19:13:38.982201 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 110/207] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:13:39.113543 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-6c2cb51a-31bc-4be5-94ad-110990a2c069 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:39.127378 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-6c2cb51a-31bc-4be5-94ad-110990a2c069 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1367 microversion: 2.1 time: 0.261296 Aug 31 19:13:39.128003 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 98/208] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:38 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1367 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:39.872802 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-0ffe3fc3-5908-4c5d-af8d-e352d78bcabf tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:39.874136 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-0ffe3fc3-5908-4c5d-af8d-e352d78bcabf tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:39.891769 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0ffe3fc3-5908-4c5d-af8d-e352d78bcabf tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:39.893384 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0ffe3fc3-5908-4c5d-af8d-e352d78bcabf tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:39.894130 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0ffe3fc3-5908-4c5d-af8d-e352d78bcabf tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:39.896158 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0ffe3fc3-5908-4c5d-af8d-e352d78bcabf tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:39.897887 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0ffe3fc3-5908-4c5d-af8d-e352d78bcabf tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:39.899521 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0ffe3fc3-5908-4c5d-af8d-e352d78bcabf tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:39.948136 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e878a229-f041-4ec0-922c-2f6fa488e5ce tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:39.949258 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-e878a229-f041-4ec0-922c-2f6fa488e5ce tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:39.956810 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e878a229-f041-4ec0-922c-2f6fa488e5ce tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:39.957588 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e878a229-f041-4ec0-922c-2f6fa488e5ce tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:39.958585 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e878a229-f041-4ec0-922c-2f6fa488e5ce tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:39.959748 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e878a229-f041-4ec0-922c-2f6fa488e5ce tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:39.960293 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e878a229-f041-4ec0-922c-2f6fa488e5ce tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:39.960949 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e878a229-f041-4ec0-922c-2f6fa488e5ce tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:40.114224 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e878a229-f041-4ec0-922c-2f6fa488e5ce tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:40.123285 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-e878a229-f041-4ec0-922c-2f6fa488e5ce tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1322 microversion: 2.1 time: 0.180466 Aug 31 19:13:40.123794 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 99/209] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:39 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:40.138836 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-0ffe3fc3-5908-4c5d-af8d-e352d78bcabf tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:40.151159 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-0ffe3fc3-5908-4c5d-af8d-e352d78bcabf tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1314 microversion: 2.1 time: 0.285578 Aug 31 19:13:40.152002 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 111/210] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:39 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:40.159031 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-98049117-682f-4845-a078-5bcbb9c32dcb tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:40.160134 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-98049117-682f-4845-a078-5bcbb9c32dcb tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:40.169516 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-98049117-682f-4845-a078-5bcbb9c32dcb tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:40.169962 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-98049117-682f-4845-a078-5bcbb9c32dcb tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:40.170392 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-98049117-682f-4845-a078-5bcbb9c32dcb tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:40.171314 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-98049117-682f-4845-a078-5bcbb9c32dcb tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:40.171767 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-98049117-682f-4845-a078-5bcbb9c32dcb tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:40.172291 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-98049117-682f-4845-a078-5bcbb9c32dcb tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:40.360185 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-98049117-682f-4845-a078-5bcbb9c32dcb tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:40.369589 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-98049117-682f-4845-a078-5bcbb9c32dcb tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1556 microversion: 2.1 time: 0.222403 Aug 31 19:13:40.370163 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 100/211] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:40 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1556 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:40.391069 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-95b889ef-f7f0-4f9a-8495-8c40a256c8fc tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:40.392117 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-95b889ef-f7f0-4f9a-8495-8c40a256c8fc tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:40.398864 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-95b889ef-f7f0-4f9a-8495-8c40a256c8fc tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:40.400093 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-95b889ef-f7f0-4f9a-8495-8c40a256c8fc tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:40.400710 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-95b889ef-f7f0-4f9a-8495-8c40a256c8fc tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:40.402121 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-95b889ef-f7f0-4f9a-8495-8c40a256c8fc tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:40.402915 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-95b889ef-f7f0-4f9a-8495-8c40a256c8fc tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:40.403493 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-95b889ef-f7f0-4f9a-8495-8c40a256c8fc tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:40.580938 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-95b889ef-f7f0-4f9a-8495-8c40a256c8fc tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.193779 Aug 31 19:13:40.581578 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 112/212] 10.222.0.65 () {58 vars in 1275 bytes} [Wed Aug 31 19:13:40 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb/os-interface => generated 284 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:13:41.143625 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-9501ecae-b61b-472b-a0af-4f42c091ce24 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:41.144228 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-9501ecae-b61b-472b-a0af-4f42c091ce24 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:41.157472 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9501ecae-b61b-472b-a0af-4f42c091ce24 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:41.158298 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9501ecae-b61b-472b-a0af-4f42c091ce24 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:41.158941 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9501ecae-b61b-472b-a0af-4f42c091ce24 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:41.160496 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9501ecae-b61b-472b-a0af-4f42c091ce24 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:41.161165 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9501ecae-b61b-472b-a0af-4f42c091ce24 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:41.161811 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9501ecae-b61b-472b-a0af-4f42c091ce24 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:41.175162 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-409ec451-e791-40ec-a57b-33f2326740d4 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:41.182639 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-409ec451-e791-40ec-a57b-33f2326740d4 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:41.213722 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-409ec451-e791-40ec-a57b-33f2326740d4 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:41.214556 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-409ec451-e791-40ec-a57b-33f2326740d4 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:41.215191 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-409ec451-e791-40ec-a57b-33f2326740d4 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:41.216943 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-409ec451-e791-40ec-a57b-33f2326740d4 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:41.217653 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-409ec451-e791-40ec-a57b-33f2326740d4 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:41.218320 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-409ec451-e791-40ec-a57b-33f2326740d4 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:41.452522 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-9501ecae-b61b-472b-a0af-4f42c091ce24 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:41.463830 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-9501ecae-b61b-472b-a0af-4f42c091ce24 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1322 microversion: 2.1 time: 0.323851 Aug 31 19:13:41.466144 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 101/213] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:41 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1322 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:41.839962 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-409ec451-e791-40ec-a57b-33f2326740d4 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:41.850426 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-409ec451-e791-40ec-a57b-33f2326740d4 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1314 microversion: 2.1 time: 0.679045 Aug 31 19:13:41.853493 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 113/214] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:41 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1314 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:42.487113 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-34cbc9c4-e593-43d0-870b-5abe02c76302 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:42.487784 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-34cbc9c4-e593-43d0-870b-5abe02c76302 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:42.498603 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-34cbc9c4-e593-43d0-870b-5abe02c76302 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:42.499009 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-34cbc9c4-e593-43d0-870b-5abe02c76302 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:42.499456 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-34cbc9c4-e593-43d0-870b-5abe02c76302 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:42.500218 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-34cbc9c4-e593-43d0-870b-5abe02c76302 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:42.500668 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-34cbc9c4-e593-43d0-870b-5abe02c76302 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:42.503891 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-34cbc9c4-e593-43d0-870b-5abe02c76302 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:42.597083 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-fe0ee18c-c5e5-4637-9638-d47725d711b9 req-1912480b-c3f1-4acc-8701-f5dc369ac28e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb", "tag": "1adf99e2-adb2-4055-815e-64ce31792411"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:13:42.608506 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-fe0ee18c-c5e5-4637-9638-d47725d711b9 req-1912480b-c3f1-4acc-8701-f5dc369ac28e service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:42.609474 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-fe0ee18c-c5e5-4637-9638-d47725d711b9 req-1912480b-c3f1-4acc-8701-f5dc369ac28e service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:42.610053 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-fe0ee18c-c5e5-4637-9638-d47725d711b9 req-1912480b-c3f1-4acc-8701-f5dc369ac28e service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:42.627712 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-fe0ee18c-c5e5-4637-9638-d47725d711b9 req-1912480b-c3f1-4acc-8701-f5dc369ac28e service nova] Creating event network-changed:1adf99e2-adb2-4055-815e-64ce31792411 for instance e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb on hv-cinder-83538 Aug 31 19:13:42.635972 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-fe0ee18c-c5e5-4637-9638-d47725d711b9 req-1912480b-c3f1-4acc-8701-f5dc369ac28e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043809 Aug 31 19:13:42.642323 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 114/215] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:13:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:13:42.875655 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-1e1f9c5e-b69f-471a-83c2-d282829bf3b9 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:42.876580 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-1e1f9c5e-b69f-471a-83c2-d282829bf3b9 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:42.884574 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1e1f9c5e-b69f-471a-83c2-d282829bf3b9 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:42.885248 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1e1f9c5e-b69f-471a-83c2-d282829bf3b9 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:42.885848 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1e1f9c5e-b69f-471a-83c2-d282829bf3b9 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:42.886977 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1e1f9c5e-b69f-471a-83c2-d282829bf3b9 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:42.887758 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1e1f9c5e-b69f-471a-83c2-d282829bf3b9 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:42.888407 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1e1f9c5e-b69f-471a-83c2-d282829bf3b9 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:42.900069 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-34cbc9c4-e593-43d0-870b-5abe02c76302 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:42.910463 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-34cbc9c4-e593-43d0-870b-5abe02c76302 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1322 microversion: 2.1 time: 0.427375 Aug 31 19:13:42.911998 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 102/216] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:42 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1322 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:43.122731 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-1e1f9c5e-b69f-471a-83c2-d282829bf3b9 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:43.132925 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-1e1f9c5e-b69f-471a-83c2-d282829bf3b9 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1314 microversion: 2.1 time: 0.262779 Aug 31 19:13:43.146163 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 115/217] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:42 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:13:43.932930 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-c842dc35-f278-43cb-996f-876539dfe0f7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:43.933807 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-c842dc35-f278-43cb-996f-876539dfe0f7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:43.945521 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c842dc35-f278-43cb-996f-876539dfe0f7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:43.945929 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c842dc35-f278-43cb-996f-876539dfe0f7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:43.946363 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c842dc35-f278-43cb-996f-876539dfe0f7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:43.947528 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c842dc35-f278-43cb-996f-876539dfe0f7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:43.952678 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c842dc35-f278-43cb-996f-876539dfe0f7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:43.953379 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c842dc35-f278-43cb-996f-876539dfe0f7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:44.155791 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-6b6286d8-ee89-4fc1-85ad-203a12962aba tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:44.156442 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-6b6286d8-ee89-4fc1-85ad-203a12962aba tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:44.167916 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6b6286d8-ee89-4fc1-85ad-203a12962aba tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:44.168410 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6b6286d8-ee89-4fc1-85ad-203a12962aba tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:44.168843 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6b6286d8-ee89-4fc1-85ad-203a12962aba tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:44.183614 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6b6286d8-ee89-4fc1-85ad-203a12962aba tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:44.183614 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6b6286d8-ee89-4fc1-85ad-203a12962aba tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:44.183614 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6b6286d8-ee89-4fc1-85ad-203a12962aba tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:44.184172 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-c842dc35-f278-43cb-996f-876539dfe0f7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:44.199384 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-c842dc35-f278-43cb-996f-876539dfe0f7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1515 microversion: 2.1 time: 0.270983 Aug 31 19:13:44.217502 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 103/218] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:43 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1515 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:44.235892 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-7ec1c8ac-a2ac-4124-ae6e-ac9e9a59ecaf tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:13:44.238967 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-7ec1c8ac-a2ac-4124-ae6e-ac9e9a59ecaf tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:44.251977 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7ec1c8ac-a2ac-4124-ae6e-ac9e9a59ecaf tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:44.252462 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7ec1c8ac-a2ac-4124-ae6e-ac9e9a59ecaf tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:44.252893 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7ec1c8ac-a2ac-4124-ae6e-ac9e9a59ecaf tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:44.267813 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7ec1c8ac-a2ac-4124-ae6e-ac9e9a59ecaf tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:44.268594 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7ec1c8ac-a2ac-4124-ae6e-ac9e9a59ecaf tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:44.269172 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7ec1c8ac-a2ac-4124-ae6e-ac9e9a59ecaf tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:44.387527 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.objects.instance [None req-7ec1c8ac-a2ac-4124-ae6e-ac9e9a59ecaf tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lazy-loading 'flavor' on Instance uuid 88b9d0d7-01c7-4a08-9a15-a20bd1db6019 {{(pid=120623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:13:44.544650 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-6b6286d8-ee89-4fc1-85ad-203a12962aba tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:44.560115 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-6b6286d8-ee89-4fc1-85ad-203a12962aba tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1501 microversion: 2.1 time: 0.408015 Aug 31 19:13:44.561357 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 116/219] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:44 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1501 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:13:44.644973 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-7ec1c8ac-a2ac-4124-ae6e-ac9e9a59ecaf tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "POST /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019/action" status: 200 len: 32 microversion: 2.1 time: 0.420011 Aug 31 19:13:44.646690 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 104/220] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 31 19:13:44 2022] POST /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019/action => generated 32 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 19:13:44.656188 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-779f8d76-c0e2-474e-95d1-e73a8c50deea tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:44.656998 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-779f8d76-c0e2-474e-95d1-e73a8c50deea tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:44.666009 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-779f8d76-c0e2-474e-95d1-e73a8c50deea tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:44.666663 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-779f8d76-c0e2-474e-95d1-e73a8c50deea tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:44.667608 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-779f8d76-c0e2-474e-95d1-e73a8c50deea tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:44.668482 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-779f8d76-c0e2-474e-95d1-e73a8c50deea tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:44.669254 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-779f8d76-c0e2-474e-95d1-e73a8c50deea tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:44.669978 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-779f8d76-c0e2-474e-95d1-e73a8c50deea tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:44.956760 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-779f8d76-c0e2-474e-95d1-e73a8c50deea tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:44.970866 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-779f8d76-c0e2-474e-95d1-e73a8c50deea tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1521 microversion: 2.1 time: 0.317545 Aug 31 19:13:44.972401 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 117/221] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:44 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1521 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:13:45.996135 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-af966421-71ed-4371-a402-6685b092b7b6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:45.997015 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-af966421-71ed-4371-a402-6685b092b7b6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:46.003303 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-af966421-71ed-4371-a402-6685b092b7b6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:46.003783 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-af966421-71ed-4371-a402-6685b092b7b6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:46.004396 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-af966421-71ed-4371-a402-6685b092b7b6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:46.005094 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-af966421-71ed-4371-a402-6685b092b7b6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:46.005575 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-af966421-71ed-4371-a402-6685b092b7b6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:46.005996 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-af966421-71ed-4371-a402-6685b092b7b6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:46.156313 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-af966421-71ed-4371-a402-6685b092b7b6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:46.165917 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-af966421-71ed-4371-a402-6685b092b7b6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1521 microversion: 2.1 time: 0.174551 Aug 31 19:13:46.166903 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 105/222] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:45 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:46.304756 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-19795bf7-252d-4128-91b6-2d989477d3cd tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "74da104c-9fce-448c-bc9d-e78b4a8a8fb1"}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:13:46.307919 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-19795bf7-252d-4128-91b6-2d989477d3cd tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:46.309916 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_api:SELECT=82 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:13:46.315514 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-19795bf7-252d-4128-91b6-2d989477d3cd tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:46.316139 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-19795bf7-252d-4128-91b6-2d989477d3cd tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:46.316563 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-19795bf7-252d-4128-91b6-2d989477d3cd tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:46.317267 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-19795bf7-252d-4128-91b6-2d989477d3cd tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:46.317778 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-19795bf7-252d-4128-91b6-2d989477d3cd tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:46.318198 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-19795bf7-252d-4128-91b6-2d989477d3cd tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:47.038767 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:13:47.049246 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-19795bf7-252d-4128-91b6-2d989477d3cd tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "POST /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.748776 Aug 31 19:13:47.049930 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 118/223] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 31 19:13:46 2022] POST /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2/os-volume_attachments => generated 194 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:13:47.190915 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-31f6d1b3-754a-4aa8-ba39-437f680472b7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:47.190915 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-31f6d1b3-754a-4aa8-ba39-437f680472b7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:47.198150 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-31f6d1b3-754a-4aa8-ba39-437f680472b7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:47.198631 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-31f6d1b3-754a-4aa8-ba39-437f680472b7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:47.199406 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-31f6d1b3-754a-4aa8-ba39-437f680472b7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:47.200096 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-31f6d1b3-754a-4aa8-ba39-437f680472b7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:47.200886 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-31f6d1b3-754a-4aa8-ba39-437f680472b7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:47.200980 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-31f6d1b3-754a-4aa8-ba39-437f680472b7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:47.338972 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-31f6d1b3-754a-4aa8-ba39-437f680472b7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:47.346562 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-31f6d1b3-754a-4aa8-ba39-437f680472b7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1521 microversion: 2.1 time: 0.163089 Aug 31 19:13:47.347217 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 106/224] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:47 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:48.370617 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-59ed30a4-f7b3-4b22-bd1e-f6ee95ec6718 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:48.371304 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-59ed30a4-f7b3-4b22-bd1e-f6ee95ec6718 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:48.378155 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-59ed30a4-f7b3-4b22-bd1e-f6ee95ec6718 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:48.378627 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-59ed30a4-f7b3-4b22-bd1e-f6ee95ec6718 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:48.379052 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-59ed30a4-f7b3-4b22-bd1e-f6ee95ec6718 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:48.379727 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-59ed30a4-f7b3-4b22-bd1e-f6ee95ec6718 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:48.380166 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-59ed30a4-f7b3-4b22-bd1e-f6ee95ec6718 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:48.380576 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-59ed30a4-f7b3-4b22-bd1e-f6ee95ec6718 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:48.520263 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-59ed30a4-f7b3-4b22-bd1e-f6ee95ec6718 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:48.528048 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-59ed30a4-f7b3-4b22-bd1e-f6ee95ec6718 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1521 microversion: 2.1 time: 0.163676 Aug 31 19:13:48.528733 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 119/225] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:48 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:49.549628 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-768713c1-6b0c-44d5-87b8-c5d0b49938ec tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:49.550242 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-768713c1-6b0c-44d5-87b8-c5d0b49938ec tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:49.556210 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-768713c1-6b0c-44d5-87b8-c5d0b49938ec tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:49.556692 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-768713c1-6b0c-44d5-87b8-c5d0b49938ec tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:49.557126 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-768713c1-6b0c-44d5-87b8-c5d0b49938ec tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:49.557854 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-768713c1-6b0c-44d5-87b8-c5d0b49938ec tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:49.558307 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-768713c1-6b0c-44d5-87b8-c5d0b49938ec tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:49.558726 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-768713c1-6b0c-44d5-87b8-c5d0b49938ec tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:49.687889 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-768713c1-6b0c-44d5-87b8-c5d0b49938ec tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:49.694784 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:13:49.698187 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-768713c1-6b0c-44d5-87b8-c5d0b49938ec tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1521 microversion: 2.1 time: 0.152315 Aug 31 19:13:49.698854 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 107/226] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:49 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:50.718936 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-78ae7502-1286-4ae0-8609-77724a80c25a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:50.719566 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-78ae7502-1286-4ae0-8609-77724a80c25a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:50.726049 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-78ae7502-1286-4ae0-8609-77724a80c25a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:50.726530 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-78ae7502-1286-4ae0-8609-77724a80c25a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:50.726961 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-78ae7502-1286-4ae0-8609-77724a80c25a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:50.728216 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-78ae7502-1286-4ae0-8609-77724a80c25a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:50.728693 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-78ae7502-1286-4ae0-8609-77724a80c25a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:50.729113 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-78ae7502-1286-4ae0-8609-77724a80c25a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:50.871419 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-78ae7502-1286-4ae0-8609-77724a80c25a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:50.878963 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-78ae7502-1286-4ae0-8609-77724a80c25a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1521 microversion: 2.1 time: 0.163907 Aug 31 19:13:50.879531 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 120/227] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:50 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:51.899272 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-f97ac1e8-20a2-4761-afb8-9861f6181c27 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:51.899884 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-f97ac1e8-20a2-4761-afb8-9861f6181c27 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:51.907456 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f97ac1e8-20a2-4761-afb8-9861f6181c27 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:51.907945 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f97ac1e8-20a2-4761-afb8-9861f6181c27 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:51.908379 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f97ac1e8-20a2-4761-afb8-9861f6181c27 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:51.909076 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f97ac1e8-20a2-4761-afb8-9861f6181c27 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:51.909566 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f97ac1e8-20a2-4761-afb8-9861f6181c27 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:51.909989 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f97ac1e8-20a2-4761-afb8-9861f6181c27 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:52.050544 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-f97ac1e8-20a2-4761-afb8-9861f6181c27 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:52.059677 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-f97ac1e8-20a2-4761-afb8-9861f6181c27 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1521 microversion: 2.1 time: 0.164537 Aug 31 19:13:52.060455 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 108/228] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:51 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:53.081266 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-73c2f439-3200-42e4-ac8a-b3469d81f26f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:53.081924 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-73c2f439-3200-42e4-ac8a-b3469d81f26f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:53.088265 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-73c2f439-3200-42e4-ac8a-b3469d81f26f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:53.089335 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-73c2f439-3200-42e4-ac8a-b3469d81f26f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:53.089771 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-73c2f439-3200-42e4-ac8a-b3469d81f26f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:53.090455 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-73c2f439-3200-42e4-ac8a-b3469d81f26f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:53.090906 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-73c2f439-3200-42e4-ac8a-b3469d81f26f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:53.091326 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-73c2f439-3200-42e4-ac8a-b3469d81f26f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:53.224915 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-73c2f439-3200-42e4-ac8a-b3469d81f26f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:53.232799 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-73c2f439-3200-42e4-ac8a-b3469d81f26f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1521 microversion: 2.1 time: 0.155129 Aug 31 19:13:53.233395 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 121/229] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:53 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:54.253606 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-b68881ed-af0b-4173-a181-579b0e98066e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:54.254427 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-b68881ed-af0b-4173-a181-579b0e98066e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:54.263989 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b68881ed-af0b-4173-a181-579b0e98066e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:54.264353 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b68881ed-af0b-4173-a181-579b0e98066e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:54.264778 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b68881ed-af0b-4173-a181-579b0e98066e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:54.267886 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b68881ed-af0b-4173-a181-579b0e98066e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:54.268721 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b68881ed-af0b-4173-a181-579b0e98066e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:54.269243 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b68881ed-af0b-4173-a181-579b0e98066e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:54.704270 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-b68881ed-af0b-4173-a181-579b0e98066e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:54.717647 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-b68881ed-af0b-4173-a181-579b0e98066e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1521 microversion: 2.1 time: 0.467620 Aug 31 19:13:54.718240 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 109/230] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:54 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1521 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:13:55.739247 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-e0ac4d63-97ed-4c78-acda-ef49fbaa60f5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:55.739929 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-e0ac4d63-97ed-4c78-acda-ef49fbaa60f5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:55.747179 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e0ac4d63-97ed-4c78-acda-ef49fbaa60f5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:55.747656 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e0ac4d63-97ed-4c78-acda-ef49fbaa60f5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:55.748079 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e0ac4d63-97ed-4c78-acda-ef49fbaa60f5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:55.748777 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e0ac4d63-97ed-4c78-acda-ef49fbaa60f5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:55.749226 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e0ac4d63-97ed-4c78-acda-ef49fbaa60f5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:55.749697 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e0ac4d63-97ed-4c78-acda-ef49fbaa60f5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:55.926419 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-e0ac4d63-97ed-4c78-acda-ef49fbaa60f5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:55.938772 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-e0ac4d63-97ed-4c78-acda-ef49fbaa60f5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1521 microversion: 2.1 time: 0.203274 Aug 31 19:13:55.939718 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 122/231] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:55 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:56.959886 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-ee33f1fa-f409-4ce5-acae-d0ea8d04d81b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:56.960495 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-ee33f1fa-f409-4ce5-acae-d0ea8d04d81b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:56.966806 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ee33f1fa-f409-4ce5-acae-d0ea8d04d81b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:56.967288 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ee33f1fa-f409-4ce5-acae-d0ea8d04d81b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:56.967722 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ee33f1fa-f409-4ce5-acae-d0ea8d04d81b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:56.968436 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ee33f1fa-f409-4ce5-acae-d0ea8d04d81b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:56.968890 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ee33f1fa-f409-4ce5-acae-d0ea8d04d81b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:56.969343 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ee33f1fa-f409-4ce5-acae-d0ea8d04d81b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:57.126455 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-ee33f1fa-f409-4ce5-acae-d0ea8d04d81b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:57.140062 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-ee33f1fa-f409-4ce5-acae-d0ea8d04d81b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1521 microversion: 2.1 time: 0.183882 Aug 31 19:13:57.140910 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 110/232] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:56 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:58.162187 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-bdda2c54-0328-4352-aaf1-b68f20f7c447 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:58.162896 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-bdda2c54-0328-4352-aaf1-b68f20f7c447 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:58.170462 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bdda2c54-0328-4352-aaf1-b68f20f7c447 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:58.171126 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bdda2c54-0328-4352-aaf1-b68f20f7c447 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:58.175035 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bdda2c54-0328-4352-aaf1-b68f20f7c447 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:58.175035 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bdda2c54-0328-4352-aaf1-b68f20f7c447 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:58.175035 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bdda2c54-0328-4352-aaf1-b68f20f7c447 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:58.175035 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bdda2c54-0328-4352-aaf1-b68f20f7c447 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:58.320358 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-bdda2c54-0328-4352-aaf1-b68f20f7c447 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:58.330494 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-bdda2c54-0328-4352-aaf1-b68f20f7c447 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1521 microversion: 2.1 time: 0.172522 Aug 31 19:13:58.331662 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 123/233] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:58 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:13:59.351422 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-dfe2bc03-3d4c-4b87-9478-ad0aa027e657 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:13:59.352048 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-dfe2bc03-3d4c-4b87-9478-ad0aa027e657 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:13:59.358772 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-dfe2bc03-3d4c-4b87-9478-ad0aa027e657 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:59.359251 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-dfe2bc03-3d4c-4b87-9478-ad0aa027e657 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:59.359678 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-dfe2bc03-3d4c-4b87-9478-ad0aa027e657 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:59.360359 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-dfe2bc03-3d4c-4b87-9478-ad0aa027e657 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:13:59.360800 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-dfe2bc03-3d4c-4b87-9478-ad0aa027e657 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:13:59.361297 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-dfe2bc03-3d4c-4b87-9478-ad0aa027e657 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:13:59.496702 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-dfe2bc03-3d4c-4b87-9478-ad0aa027e657 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:13:59.504490 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-dfe2bc03-3d4c-4b87-9478-ad0aa027e657 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1521 microversion: 2.1 time: 0.156870 Aug 31 19:13:59.505134 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 111/234] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:13:59 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:00.526949 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-5bfa9e50-4e6d-4a2d-917e-d98f920678a6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:00.527639 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-5bfa9e50-4e6d-4a2d-917e-d98f920678a6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:00.534893 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5bfa9e50-4e6d-4a2d-917e-d98f920678a6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:00.535440 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5bfa9e50-4e6d-4a2d-917e-d98f920678a6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:00.536119 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5bfa9e50-4e6d-4a2d-917e-d98f920678a6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:00.537336 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5bfa9e50-4e6d-4a2d-917e-d98f920678a6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:00.537603 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5bfa9e50-4e6d-4a2d-917e-d98f920678a6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:00.538098 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5bfa9e50-4e6d-4a2d-917e-d98f920678a6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:00.547320 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-ef29d825-1748-4e41-99b6-d8022600d0a5 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1027273002", "imageRef": "f4f2ae76-bacc-4449-881b-f697e1eeec66", "flavorRef": "452", "networks": [{"uuid": "1dacb2b3-715e-4017-bcf1-0c1b62ea3e3f"}]}} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:14:00.602558 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.network.neutron [None req-ef29d825-1748-4e41-99b6-d8022600d0a5 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] validate_networks() for [('1dacb2b3-715e-4017-bcf1-0c1b62ea3e3f', None, None, None, None, None)] {{(pid=120623) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:14:00.683978 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-5bfa9e50-4e6d-4a2d-917e-d98f920678a6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:00.692577 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-5bfa9e50-4e6d-4a2d-917e-d98f920678a6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1521 microversion: 2.1 time: 0.170432 Aug 31 19:14:00.693299 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 124/235] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:00 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:00.962687 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-ef29d825-1748-4e41-99b6-d8022600d0a5 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Flavor limits 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:14:00.963110 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-ef29d825-1748-4e41-99b6-d8022600d0a5 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Image limits 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:14:00.964243 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-ef29d825-1748-4e41-99b6-d8022600d0a5 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Flavor pref 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:14:00.964676 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-ef29d825-1748-4e41-99b6-d8022600d0a5 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Image pref 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:14:00.965085 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-ef29d825-1748-4e41-99b6-d8022600d0a5 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:14:00.974671 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ef29d825-1748-4e41-99b6-d8022600d0a5 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:00.975155 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ef29d825-1748-4e41-99b6-d8022600d0a5 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:00.975585 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ef29d825-1748-4e41-99b6-d8022600d0a5 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:00.976308 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ef29d825-1748-4e41-99b6-d8022600d0a5 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:00.976762 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ef29d825-1748-4e41-99b6-d8022600d0a5 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:00.977180 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ef29d825-1748-4e41-99b6-d8022600d0a5 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:00.995777 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.quota [None req-ef29d825-1748-4e41-99b6-d8022600d0a5 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Getting quotas for project 426e58f469324233b3514e866529eafa. Resources: {'instances', 'cores', 'ram'} {{(pid=120623) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:14:00.999769 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.quota [None req-ef29d825-1748-4e41-99b6-d8022600d0a5 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Getting quotas for user e33c120ef02f4f6e8bea53107d90034b and project 426e58f469324233b3514e866529eafa. Resources: {'instances', 'cores', 'ram'} {{(pid=120623) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:14:01.011184 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-ef29d825-1748-4e41-99b6-d8022600d0a5 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Going to run 1 instances... {{(pid=120623) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:14:01.013782 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-ef29d825-1748-4e41-99b6-d8022600d0a5 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 7631e09a-0908-4af8-960d-bb7ba652ec45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f4f2ae76-bacc-4449-881b-f697e1eeec66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120623) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:14:01.066831 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-ef29d825-1748-4e41-99b6-d8022600d0a5 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.523571 Aug 31 19:14:01.067478 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 112/236] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 31 19:14:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 526 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 19:14:01.078066 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-b6ff581b-e8ff-492a-bb7f-5145f1be0b0b tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:01.078678 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-b6ff581b-e8ff-492a-bb7f-5145f1be0b0b tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 7631e09a-0908-4af8-960d-bb7ba652ec45] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:01.135815 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-b6ff581b-e8ff-492a-bb7f-5145f1be0b0b tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:01.145025 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-b6ff581b-e8ff-492a-bb7f-5145f1be0b0b tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45" status: 200 len: 1214 microversion: 2.1 time: 0.070666 Aug 31 19:14:01.145636 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 125/237] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:01 2022] GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45 => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:01.715102 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-a2d56ffb-5936-4431-b29c-69ec58528987 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:01.715605 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-a2d56ffb-5936-4431-b29c-69ec58528987 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:01.722704 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a2d56ffb-5936-4431-b29c-69ec58528987 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:01.723203 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a2d56ffb-5936-4431-b29c-69ec58528987 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:01.723643 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a2d56ffb-5936-4431-b29c-69ec58528987 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:01.724984 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a2d56ffb-5936-4431-b29c-69ec58528987 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:01.725522 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a2d56ffb-5936-4431-b29c-69ec58528987 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:01.725957 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a2d56ffb-5936-4431-b29c-69ec58528987 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:01.873145 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-a2d56ffb-5936-4431-b29c-69ec58528987 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:01.890205 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-a2d56ffb-5936-4431-b29c-69ec58528987 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1521 microversion: 2.1 time: 0.171757 Aug 31 19:14:01.890205 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 113/238] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:01 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:02.167496 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-e65fa561-342a-4027-bec9-055c52d7469e tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:02.168206 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-e65fa561-342a-4027-bec9-055c52d7469e tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 7631e09a-0908-4af8-960d-bb7ba652ec45] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:02.175716 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e65fa561-342a-4027-bec9-055c52d7469e tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:02.176221 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e65fa561-342a-4027-bec9-055c52d7469e tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:02.176649 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e65fa561-342a-4027-bec9-055c52d7469e tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:02.177482 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e65fa561-342a-4027-bec9-055c52d7469e tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:02.177930 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e65fa561-342a-4027-bec9-055c52d7469e tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:02.178346 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e65fa561-342a-4027-bec9-055c52d7469e tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:02.240618 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-e65fa561-342a-4027-bec9-055c52d7469e tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:02.248715 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-e65fa561-342a-4027-bec9-055c52d7469e tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45" status: 200 len: 1266 microversion: 2.1 time: 0.085595 Aug 31 19:14:02.249298 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 126/239] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:02 2022] GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45 => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:02.918310 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-3675b108-7ec1-4d69-bdf4-bd5b1349110e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:02.918938 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-3675b108-7ec1-4d69-bdf4-bd5b1349110e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:02.924831 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3675b108-7ec1-4d69-bdf4-bd5b1349110e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:02.925336 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3675b108-7ec1-4d69-bdf4-bd5b1349110e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:02.925767 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3675b108-7ec1-4d69-bdf4-bd5b1349110e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:02.926447 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3675b108-7ec1-4d69-bdf4-bd5b1349110e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:02.926895 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3675b108-7ec1-4d69-bdf4-bd5b1349110e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:02.927310 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3675b108-7ec1-4d69-bdf4-bd5b1349110e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:03.058466 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-3675b108-7ec1-4d69-bdf4-bd5b1349110e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:03.066117 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-3675b108-7ec1-4d69-bdf4-bd5b1349110e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1521 microversion: 2.1 time: 0.159518 Aug 31 19:14:03.066678 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 114/240] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:02 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:03.269440 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-b62c3e47-54fd-4e10-9ea9-e77274c2ea1e tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:03.270044 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-b62c3e47-54fd-4e10-9ea9-e77274c2ea1e tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 7631e09a-0908-4af8-960d-bb7ba652ec45] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:03.276380 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b62c3e47-54fd-4e10-9ea9-e77274c2ea1e tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:03.276851 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b62c3e47-54fd-4e10-9ea9-e77274c2ea1e tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:03.277294 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b62c3e47-54fd-4e10-9ea9-e77274c2ea1e tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:03.277976 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b62c3e47-54fd-4e10-9ea9-e77274c2ea1e tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:03.278424 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b62c3e47-54fd-4e10-9ea9-e77274c2ea1e tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:03.278842 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b62c3e47-54fd-4e10-9ea9-e77274c2ea1e tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:03.340202 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-b62c3e47-54fd-4e10-9ea9-e77274c2ea1e tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:03.349001 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-b62c3e47-54fd-4e10-9ea9-e77274c2ea1e tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45" status: 200 len: 1266 microversion: 2.1 time: 0.083405 Aug 31 19:14:03.349611 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 127/241] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:03 2022] GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45 => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:04.087224 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-8b7cfd48-1843-465c-afd6-16d6e75b7ae7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:04.087830 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-8b7cfd48-1843-465c-afd6-16d6e75b7ae7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:04.094318 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8b7cfd48-1843-465c-afd6-16d6e75b7ae7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:04.094798 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8b7cfd48-1843-465c-afd6-16d6e75b7ae7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:04.095227 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8b7cfd48-1843-465c-afd6-16d6e75b7ae7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:04.095904 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8b7cfd48-1843-465c-afd6-16d6e75b7ae7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:04.096366 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8b7cfd48-1843-465c-afd6-16d6e75b7ae7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:04.096774 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8b7cfd48-1843-465c-afd6-16d6e75b7ae7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:04.239387 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-8b7cfd48-1843-465c-afd6-16d6e75b7ae7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:04.247185 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-8b7cfd48-1843-465c-afd6-16d6e75b7ae7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1521 microversion: 2.1 time: 0.163800 Aug 31 19:14:04.247727 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 115/242] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:04 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:04.369771 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-0e1dabc9-76dd-43bd-94a2-08a66540bfe0 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:04.370308 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-0e1dabc9-76dd-43bd-94a2-08a66540bfe0 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 7631e09a-0908-4af8-960d-bb7ba652ec45] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:04.376968 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0e1dabc9-76dd-43bd-94a2-08a66540bfe0 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:04.377485 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0e1dabc9-76dd-43bd-94a2-08a66540bfe0 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:04.377918 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0e1dabc9-76dd-43bd-94a2-08a66540bfe0 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:04.378600 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0e1dabc9-76dd-43bd-94a2-08a66540bfe0 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:04.379051 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0e1dabc9-76dd-43bd-94a2-08a66540bfe0 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:04.379473 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0e1dabc9-76dd-43bd-94a2-08a66540bfe0 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:04.439371 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-0e1dabc9-76dd-43bd-94a2-08a66540bfe0 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:04.447033 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-0e1dabc9-76dd-43bd-94a2-08a66540bfe0 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45" status: 200 len: 1266 microversion: 2.1 time: 0.081151 Aug 31 19:14:04.448112 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 128/243] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:04 2022] GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45 => generated 1266 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:05.267897 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-c72cbb75-d8a0-4d77-810a-eb5a70a44c9d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:05.268507 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-c72cbb75-d8a0-4d77-810a-eb5a70a44c9d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:05.274525 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c72cbb75-d8a0-4d77-810a-eb5a70a44c9d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:05.275054 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c72cbb75-d8a0-4d77-810a-eb5a70a44c9d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:05.275430 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c72cbb75-d8a0-4d77-810a-eb5a70a44c9d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:05.276121 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c72cbb75-d8a0-4d77-810a-eb5a70a44c9d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:05.276574 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c72cbb75-d8a0-4d77-810a-eb5a70a44c9d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:05.276993 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c72cbb75-d8a0-4d77-810a-eb5a70a44c9d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:05.412183 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-c72cbb75-d8a0-4d77-810a-eb5a70a44c9d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:05.420495 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-c72cbb75-d8a0-4d77-810a-eb5a70a44c9d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1521 microversion: 2.1 time: 0.156550 Aug 31 19:14:05.421057 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 116/244] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:05 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:05.469335 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-e3ad3166-5bd8-4f65-b7c3-a9fcfaa65ec2 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:05.469878 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-e3ad3166-5bd8-4f65-b7c3-a9fcfaa65ec2 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 7631e09a-0908-4af8-960d-bb7ba652ec45] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:05.476282 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e3ad3166-5bd8-4f65-b7c3-a9fcfaa65ec2 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:05.476759 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e3ad3166-5bd8-4f65-b7c3-a9fcfaa65ec2 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:05.477206 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e3ad3166-5bd8-4f65-b7c3-a9fcfaa65ec2 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:05.477892 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e3ad3166-5bd8-4f65-b7c3-a9fcfaa65ec2 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:05.478341 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e3ad3166-5bd8-4f65-b7c3-a9fcfaa65ec2 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:05.479301 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e3ad3166-5bd8-4f65-b7c3-a9fcfaa65ec2 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:05.547476 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-e3ad3166-5bd8-4f65-b7c3-a9fcfaa65ec2 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:05.555114 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-e3ad3166-5bd8-4f65-b7c3-a9fcfaa65ec2 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45" status: 200 len: 1266 microversion: 2.1 time: 0.089759 Aug 31 19:14:05.555883 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 129/245] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:05 2022] GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45 => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:06.441642 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-26d7f904-571f-4575-8af5-9feb151250ab tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:06.442936 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-26d7f904-571f-4575-8af5-9feb151250ab tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:06.449816 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-26d7f904-571f-4575-8af5-9feb151250ab tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:06.450394 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-26d7f904-571f-4575-8af5-9feb151250ab tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:06.450890 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-26d7f904-571f-4575-8af5-9feb151250ab tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:06.451656 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-26d7f904-571f-4575-8af5-9feb151250ab tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:06.452176 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-26d7f904-571f-4575-8af5-9feb151250ab tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:06.452670 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-26d7f904-571f-4575-8af5-9feb151250ab tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:06.578434 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-8d93d1a6-7ba0-4698-aaa1-5a3228aa81f8 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:06.580044 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-8d93d1a6-7ba0-4698-aaa1-5a3228aa81f8 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 7631e09a-0908-4af8-960d-bb7ba652ec45] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:06.588211 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8d93d1a6-7ba0-4698-aaa1-5a3228aa81f8 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:06.589091 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8d93d1a6-7ba0-4698-aaa1-5a3228aa81f8 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:06.590056 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8d93d1a6-7ba0-4698-aaa1-5a3228aa81f8 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:06.591210 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8d93d1a6-7ba0-4698-aaa1-5a3228aa81f8 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:06.591874 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8d93d1a6-7ba0-4698-aaa1-5a3228aa81f8 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:06.592494 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8d93d1a6-7ba0-4698-aaa1-5a3228aa81f8 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:06.633593 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-26d7f904-571f-4575-8af5-9feb151250ab tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:06.641734 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-26d7f904-571f-4575-8af5-9feb151250ab tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1521 microversion: 2.1 time: 0.203910 Aug 31 19:14:06.642313 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 117/246] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:06 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:06.808795 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-8d93d1a6-7ba0-4698-aaa1-5a3228aa81f8 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:06.817139 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-8d93d1a6-7ba0-4698-aaa1-5a3228aa81f8 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45" status: 200 len: 1314 microversion: 2.1 time: 0.245222 Aug 31 19:14:06.817732 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 130/247] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:06 2022] GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:07.661838 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-5e759959-c1a7-4b0a-ba4b-a681c946365a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:07.662504 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-5e759959-c1a7-4b0a-ba4b-a681c946365a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:07.665445 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:14:07.669840 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5e759959-c1a7-4b0a-ba4b-a681c946365a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:07.670391 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5e759959-c1a7-4b0a-ba4b-a681c946365a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:07.670827 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5e759959-c1a7-4b0a-ba4b-a681c946365a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:07.671522 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5e759959-c1a7-4b0a-ba4b-a681c946365a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:07.671975 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5e759959-c1a7-4b0a-ba4b-a681c946365a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:07.672397 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5e759959-c1a7-4b0a-ba4b-a681c946365a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:07.839598 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-b67d71e0-547d-441c-8fc2-4cbc059a0480 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:07.840208 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-b67d71e0-547d-441c-8fc2-4cbc059a0480 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 7631e09a-0908-4af8-960d-bb7ba652ec45] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:07.843055 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-5e759959-c1a7-4b0a-ba4b-a681c946365a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:07.850381 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b67d71e0-547d-441c-8fc2-4cbc059a0480 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:07.850873 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b67d71e0-547d-441c-8fc2-4cbc059a0480 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:07.850998 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-5e759959-c1a7-4b0a-ba4b-a681c946365a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1521 microversion: 2.1 time: 0.192941 Aug 31 19:14:07.851305 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b67d71e0-547d-441c-8fc2-4cbc059a0480 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:07.851494 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 118/248] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:07 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:07.852006 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b67d71e0-547d-441c-8fc2-4cbc059a0480 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:07.852452 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b67d71e0-547d-441c-8fc2-4cbc059a0480 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:07.852867 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b67d71e0-547d-441c-8fc2-4cbc059a0480 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:07.988148 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-b67d71e0-547d-441c-8fc2-4cbc059a0480 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:07.996629 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-b67d71e0-547d-441c-8fc2-4cbc059a0480 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45" status: 200 len: 1314 microversion: 2.1 time: 0.161037 Aug 31 19:14:07.997585 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 131/249] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:07 2022] GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:14:08.872575 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-45ba804d-aa3c-4fa6-a47c-7a83dd6a5f4f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:08.873215 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-45ba804d-aa3c-4fa6-a47c-7a83dd6a5f4f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:08.879469 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-45ba804d-aa3c-4fa6-a47c-7a83dd6a5f4f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:08.880304 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-45ba804d-aa3c-4fa6-a47c-7a83dd6a5f4f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:08.880779 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-45ba804d-aa3c-4fa6-a47c-7a83dd6a5f4f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:08.881507 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-45ba804d-aa3c-4fa6-a47c-7a83dd6a5f4f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:08.882000 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-45ba804d-aa3c-4fa6-a47c-7a83dd6a5f4f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:08.882651 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-45ba804d-aa3c-4fa6-a47c-7a83dd6a5f4f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:09.019442 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-9ee34473-df91-43bd-8251-de2682e941d6 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:09.020907 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-9ee34473-df91-43bd-8251-de2682e941d6 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 7631e09a-0908-4af8-960d-bb7ba652ec45] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:09.030157 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9ee34473-df91-43bd-8251-de2682e941d6 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:09.031297 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9ee34473-df91-43bd-8251-de2682e941d6 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:09.032505 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-45ba804d-aa3c-4fa6-a47c-7a83dd6a5f4f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:09.032865 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9ee34473-df91-43bd-8251-de2682e941d6 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:09.033606 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9ee34473-df91-43bd-8251-de2682e941d6 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:09.034298 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9ee34473-df91-43bd-8251-de2682e941d6 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:09.035069 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9ee34473-df91-43bd-8251-de2682e941d6 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:09.041292 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-45ba804d-aa3c-4fa6-a47c-7a83dd6a5f4f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1521 microversion: 2.1 time: 0.173206 Aug 31 19:14:09.042246 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 119/250] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:08 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:09.183947 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-9ee34473-df91-43bd-8251-de2682e941d6 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:09.197105 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-9ee34473-df91-43bd-8251-de2682e941d6 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45" status: 200 len: 1314 microversion: 2.1 time: 0.182078 Aug 31 19:14:09.197359 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 132/251] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:09 2022] GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:14:10.061967 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e6c37007-5848-4213-9877-fae747a76a74 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:10.061967 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-e6c37007-5848-4213-9877-fae747a76a74 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:10.072678 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e6c37007-5848-4213-9877-fae747a76a74 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:10.072678 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e6c37007-5848-4213-9877-fae747a76a74 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:10.072678 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e6c37007-5848-4213-9877-fae747a76a74 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:10.072678 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e6c37007-5848-4213-9877-fae747a76a74 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:10.073307 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e6c37007-5848-4213-9877-fae747a76a74 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:10.073307 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e6c37007-5848-4213-9877-fae747a76a74 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:10.208893 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e6c37007-5848-4213-9877-fae747a76a74 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:10.218614 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-f283a4af-0b54-44b5-938f-9f47e598f147 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:10.219227 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-f283a4af-0b54-44b5-938f-9f47e598f147 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 7631e09a-0908-4af8-960d-bb7ba652ec45] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:10.226677 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f283a4af-0b54-44b5-938f-9f47e598f147 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:10.227029 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-e6c37007-5848-4213-9877-fae747a76a74 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1521 microversion: 2.1 time: 0.169676 Aug 31 19:14:10.227287 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f283a4af-0b54-44b5-938f-9f47e598f147 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:10.227609 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 120/252] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:10 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:10.240842 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f283a4af-0b54-44b5-938f-9f47e598f147 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:10.240842 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f283a4af-0b54-44b5-938f-9f47e598f147 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:10.240842 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f283a4af-0b54-44b5-938f-9f47e598f147 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:10.240842 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f283a4af-0b54-44b5-938f-9f47e598f147 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:10.370587 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-f283a4af-0b54-44b5-938f-9f47e598f147 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:10.378314 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-f283a4af-0b54-44b5-938f-9f47e598f147 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45" status: 200 len: 1314 microversion: 2.1 time: 0.163580 Aug 31 19:14:10.378935 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 133/253] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:10 2022] GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:11.248265 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-ef1ac5ec-38bb-4c57-bd69-5c5ab6bf7942 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:11.248896 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-ef1ac5ec-38bb-4c57-bd69-5c5ab6bf7942 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:11.250733 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell0:SELECT=2 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:14:11.251415 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell0:SELECT=6 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:14:11.257473 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ef1ac5ec-38bb-4c57-bd69-5c5ab6bf7942 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:11.257944 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ef1ac5ec-38bb-4c57-bd69-5c5ab6bf7942 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:11.258372 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ef1ac5ec-38bb-4c57-bd69-5c5ab6bf7942 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:11.259047 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ef1ac5ec-38bb-4c57-bd69-5c5ab6bf7942 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:11.259493 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ef1ac5ec-38bb-4c57-bd69-5c5ab6bf7942 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:11.259908 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ef1ac5ec-38bb-4c57-bd69-5c5ab6bf7942 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:11.388082 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-ef1ac5ec-38bb-4c57-bd69-5c5ab6bf7942 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:11.396466 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-ef1ac5ec-38bb-4c57-bd69-5c5ab6bf7942 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1521 microversion: 2.1 time: 0.152461 Aug 31 19:14:11.397028 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 121/254] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:11 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:11.401466 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-d1790ec1-2599-4d50-aa51-f379b1f2fe34 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:11.402080 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-d1790ec1-2599-4d50-aa51-f379b1f2fe34 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 7631e09a-0908-4af8-960d-bb7ba652ec45] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:11.404209 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell0:SELECT=2 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:14:11.410116 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d1790ec1-2599-4d50-aa51-f379b1f2fe34 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:11.410599 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d1790ec1-2599-4d50-aa51-f379b1f2fe34 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:11.411080 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d1790ec1-2599-4d50-aa51-f379b1f2fe34 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:11.411749 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d1790ec1-2599-4d50-aa51-f379b1f2fe34 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:11.412216 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d1790ec1-2599-4d50-aa51-f379b1f2fe34 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:11.412621 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d1790ec1-2599-4d50-aa51-f379b1f2fe34 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:11.549676 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-d1790ec1-2599-4d50-aa51-f379b1f2fe34 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:11.557214 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-d1790ec1-2599-4d50-aa51-f379b1f2fe34 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45" status: 200 len: 1314 microversion: 2.1 time: 0.159825 Aug 31 19:14:11.558346 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 134/255] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:11 2022] GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:14:12.415513 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-42b4657a-1e54-4c45-bdaa-918d05a03fd5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:12.416111 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-42b4657a-1e54-4c45-bdaa-918d05a03fd5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:12.422763 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-42b4657a-1e54-4c45-bdaa-918d05a03fd5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:12.423268 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-42b4657a-1e54-4c45-bdaa-918d05a03fd5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:12.423693 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-42b4657a-1e54-4c45-bdaa-918d05a03fd5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:12.424367 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-42b4657a-1e54-4c45-bdaa-918d05a03fd5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:12.424806 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-42b4657a-1e54-4c45-bdaa-918d05a03fd5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:12.425236 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-42b4657a-1e54-4c45-bdaa-918d05a03fd5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:12.568565 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-42b4657a-1e54-4c45-bdaa-918d05a03fd5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:12.576837 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-42b4657a-1e54-4c45-bdaa-918d05a03fd5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1521 microversion: 2.1 time: 0.165011 Aug 31 19:14:12.577433 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 122/256] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:12 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:12.578349 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-316b2ea5-f79d-4824-8850-b703a1bd6f9f tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:12.578988 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-316b2ea5-f79d-4824-8850-b703a1bd6f9f tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 7631e09a-0908-4af8-960d-bb7ba652ec45] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:12.585477 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-316b2ea5-f79d-4824-8850-b703a1bd6f9f tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:12.585960 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-316b2ea5-f79d-4824-8850-b703a1bd6f9f tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:12.586392 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-316b2ea5-f79d-4824-8850-b703a1bd6f9f tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:12.587099 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-316b2ea5-f79d-4824-8850-b703a1bd6f9f tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:12.587554 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-316b2ea5-f79d-4824-8850-b703a1bd6f9f tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:12.587978 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-316b2ea5-f79d-4824-8850-b703a1bd6f9f tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:12.913333 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-316b2ea5-f79d-4824-8850-b703a1bd6f9f tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:12.921492 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-316b2ea5-f79d-4824-8850-b703a1bd6f9f tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45" status: 200 len: 1314 microversion: 2.1 time: 0.347131 Aug 31 19:14:12.922049 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 135/257] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:12 2022] GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45 => generated 1314 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:13.597927 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d479c435-4448-49d0-9e8c-bf84efded220 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:13.599636 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d479c435-4448-49d0-9e8c-bf84efded220 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:13.607287 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d479c435-4448-49d0-9e8c-bf84efded220 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:13.607873 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d479c435-4448-49d0-9e8c-bf84efded220 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:13.608385 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d479c435-4448-49d0-9e8c-bf84efded220 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:13.609375 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d479c435-4448-49d0-9e8c-bf84efded220 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:13.609907 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d479c435-4448-49d0-9e8c-bf84efded220 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:13.610337 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d479c435-4448-49d0-9e8c-bf84efded220 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:13.881337 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-d479c435-4448-49d0-9e8c-bf84efded220 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:13.892499 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-d479c435-4448-49d0-9e8c-bf84efded220 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1521 microversion: 2.1 time: 0.297251 Aug 31 19:14:13.893239 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 123/258] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:13 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1521 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:13.943106 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-810e76ad-ab2c-4153-b3de-525bed854b26 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:13.944343 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-810e76ad-ab2c-4153-b3de-525bed854b26 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 7631e09a-0908-4af8-960d-bb7ba652ec45] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:13.954710 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-810e76ad-ab2c-4153-b3de-525bed854b26 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:13.955260 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-810e76ad-ab2c-4153-b3de-525bed854b26 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:13.956252 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-810e76ad-ab2c-4153-b3de-525bed854b26 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:13.957872 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-810e76ad-ab2c-4153-b3de-525bed854b26 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:13.958425 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-810e76ad-ab2c-4153-b3de-525bed854b26 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:13.958922 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-810e76ad-ab2c-4153-b3de-525bed854b26 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:13.995195 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=100 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:14:14.095501 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-9a355657-0613-4609-97e2-5687b3bb0d30 req-8ac291f8-de3b-4a10-91c1-1e4aee9804ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7631e09a-0908-4af8-960d-bb7ba652ec45", "tag": "d1d15f84-67e7-4f44-bb8a-4f9b57959e72"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:14:14.110876 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-9a355657-0613-4609-97e2-5687b3bb0d30 req-8ac291f8-de3b-4a10-91c1-1e4aee9804ef service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:14.111795 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-9a355657-0613-4609-97e2-5687b3bb0d30 req-8ac291f8-de3b-4a10-91c1-1e4aee9804ef service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:14.112464 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-9a355657-0613-4609-97e2-5687b3bb0d30 req-8ac291f8-de3b-4a10-91c1-1e4aee9804ef service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:14.128701 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-9a355657-0613-4609-97e2-5687b3bb0d30 req-8ac291f8-de3b-4a10-91c1-1e4aee9804ef service nova] Creating event network-changed:d1d15f84-67e7-4f44-bb8a-4f9b57959e72 for instance 7631e09a-0908-4af8-960d-bb7ba652ec45 on hv-cinder-83538 Aug 31 19:14:14.134835 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-9a355657-0613-4609-97e2-5687b3bb0d30 req-8ac291f8-de3b-4a10-91c1-1e4aee9804ef service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045342 Aug 31 19:14:14.136322 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 124/259] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:14:14.160612 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-810e76ad-ab2c-4153-b3de-525bed854b26 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:14.172700 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-810e76ad-ab2c-4153-b3de-525bed854b26 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45" status: 200 len: 1314 microversion: 2.1 time: 0.233404 Aug 31 19:14:14.181880 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 136/260] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:13 2022] GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:14.915242 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-5dd49b3b-e30f-45f9-90f0-2cfa11ee53c0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:14.915944 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-5dd49b3b-e30f-45f9-90f0-2cfa11ee53c0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:14.922400 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5dd49b3b-e30f-45f9-90f0-2cfa11ee53c0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:14.922895 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5dd49b3b-e30f-45f9-90f0-2cfa11ee53c0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:14.923326 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5dd49b3b-e30f-45f9-90f0-2cfa11ee53c0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:14.924022 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5dd49b3b-e30f-45f9-90f0-2cfa11ee53c0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:14.924466 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5dd49b3b-e30f-45f9-90f0-2cfa11ee53c0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:14.924968 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5dd49b3b-e30f-45f9-90f0-2cfa11ee53c0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:15.196156 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-c1625621-ae69-409e-8e1b-37e9224bf81e tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:15.196793 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-c1625621-ae69-409e-8e1b-37e9224bf81e tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 7631e09a-0908-4af8-960d-bb7ba652ec45] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:15.206703 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c1625621-ae69-409e-8e1b-37e9224bf81e tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:15.206703 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c1625621-ae69-409e-8e1b-37e9224bf81e tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:15.207341 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c1625621-ae69-409e-8e1b-37e9224bf81e tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:15.209053 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c1625621-ae69-409e-8e1b-37e9224bf81e tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:15.209609 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c1625621-ae69-409e-8e1b-37e9224bf81e tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:15.210044 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c1625621-ae69-409e-8e1b-37e9224bf81e tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:15.358765 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-5dd49b3b-e30f-45f9-90f0-2cfa11ee53c0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:15.362911 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=100 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:14:15.367754 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-5dd49b3b-e30f-45f9-90f0-2cfa11ee53c0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1521 microversion: 2.1 time: 0.457068 Aug 31 19:14:15.369618 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 125/261] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:14 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1521 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:15.375344 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-aa0500f0-ee0d-4404-80ea-936567360d1e tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:15.376028 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-aa0500f0-ee0d-4404-80ea-936567360d1e tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:15.380696 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-c1625621-ae69-409e-8e1b-37e9224bf81e tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:15.382319 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-aa0500f0-ee0d-4404-80ea-936567360d1e tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:15.382799 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-aa0500f0-ee0d-4404-80ea-936567360d1e tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:15.383232 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-aa0500f0-ee0d-4404-80ea-936567360d1e tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:15.383923 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-aa0500f0-ee0d-4404-80ea-936567360d1e tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:15.384370 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-aa0500f0-ee0d-4404-80ea-936567360d1e tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:15.384788 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-aa0500f0-ee0d-4404-80ea-936567360d1e tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:15.389353 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-c1625621-ae69-409e-8e1b-37e9224bf81e tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45" status: 200 len: 1314 microversion: 2.1 time: 0.197427 Aug 31 19:14:15.389950 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 137/262] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:15 2022] GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:14:15.410207 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-aa0500f0-ee0d-4404-80ea-936567360d1e tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Going to try to terminate instance {{(pid=120623) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 19:14:15.491616 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-aa0500f0-ee0d-4404-80ea-936567360d1e tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "DELETE /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 204 len: 0 microversion: 2.1 time: 0.120998 Aug 31 19:14:15.492120 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 126/263] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 31 19:14:15 2022] DELETE /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:14:15.500752 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-801a023a-7000-4505-aac1-3ba1cb528ec6 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:15.501393 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-801a023a-7000-4505-aac1-3ba1cb528ec6 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:15.507805 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-801a023a-7000-4505-aac1-3ba1cb528ec6 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:15.508303 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-801a023a-7000-4505-aac1-3ba1cb528ec6 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:15.508738 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-801a023a-7000-4505-aac1-3ba1cb528ec6 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:15.509481 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-801a023a-7000-4505-aac1-3ba1cb528ec6 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:15.509933 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-801a023a-7000-4505-aac1-3ba1cb528ec6 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:15.510354 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-801a023a-7000-4505-aac1-3ba1cb528ec6 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:15.644224 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-801a023a-7000-4505-aac1-3ba1cb528ec6 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:15.652499 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-801a023a-7000-4505-aac1-3ba1cb528ec6 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1553 microversion: 2.1 time: 0.155503 Aug 31 19:14:15.653067 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 138/264] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:15 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:14:16.390184 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-c6cd530a-d3d5-4575-82b6-d4132ecaa765 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:16.390778 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-c6cd530a-d3d5-4575-82b6-d4132ecaa765 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:16.396784 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c6cd530a-d3d5-4575-82b6-d4132ecaa765 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:16.397313 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c6cd530a-d3d5-4575-82b6-d4132ecaa765 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:16.397770 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c6cd530a-d3d5-4575-82b6-d4132ecaa765 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:16.398416 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c6cd530a-d3d5-4575-82b6-d4132ecaa765 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:16.398862 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c6cd530a-d3d5-4575-82b6-d4132ecaa765 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:16.399309 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c6cd530a-d3d5-4575-82b6-d4132ecaa765 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:16.409427 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-24d329da-e032-4532-812c-428ab633d454 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:16.410177 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-24d329da-e032-4532-812c-428ab633d454 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 7631e09a-0908-4af8-960d-bb7ba652ec45] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:16.413912 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_api:SELECT=44 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:14:16.417908 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-24d329da-e032-4532-812c-428ab633d454 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:16.418527 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-24d329da-e032-4532-812c-428ab633d454 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:16.419064 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-24d329da-e032-4532-812c-428ab633d454 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:16.419864 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-24d329da-e032-4532-812c-428ab633d454 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:16.420425 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-24d329da-e032-4532-812c-428ab633d454 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:16.420996 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-24d329da-e032-4532-812c-428ab633d454 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:16.555534 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-c6cd530a-d3d5-4575-82b6-d4132ecaa765 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:16.563458 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-24d329da-e032-4532-812c-428ab633d454 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:16.570532 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-c6cd530a-d3d5-4575-82b6-d4132ecaa765 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1521 microversion: 2.1 time: 0.185003 Aug 31 19:14:16.571126 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-24d329da-e032-4532-812c-428ab633d454 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45" status: 200 len: 1314 microversion: 2.1 time: 0.165668 Aug 31 19:14:16.571694 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 139/265] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:16 2022] GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:16.571827 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 127/266] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:16 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:16.673302 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-ab3b805c-718f-4c3f-9944-1a5af8a538c5 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:16.673905 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-ab3b805c-718f-4c3f-9944-1a5af8a538c5 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:16.679822 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ab3b805c-718f-4c3f-9944-1a5af8a538c5 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:16.680302 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ab3b805c-718f-4c3f-9944-1a5af8a538c5 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:16.680730 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ab3b805c-718f-4c3f-9944-1a5af8a538c5 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:16.681437 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ab3b805c-718f-4c3f-9944-1a5af8a538c5 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:16.681886 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ab3b805c-718f-4c3f-9944-1a5af8a538c5 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:16.682547 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ab3b805c-718f-4c3f-9944-1a5af8a538c5 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:16.810228 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-ab3b805c-718f-4c3f-9944-1a5af8a538c5 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:16.818395 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-ab3b805c-718f-4c3f-9944-1a5af8a538c5 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1553 microversion: 2.1 time: 0.149022 Aug 31 19:14:16.818951 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 140/267] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:16 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1553 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:17.592012 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-bd64eb11-8f3e-4873-b45a-48d42b95aa16 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:17.592531 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-48f73ca7-7cdb-4f92-ba71-adbb259aed30 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:17.592890 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-bd64eb11-8f3e-4873-b45a-48d42b95aa16 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:17.592981 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-48f73ca7-7cdb-4f92-ba71-adbb259aed30 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 7631e09a-0908-4af8-960d-bb7ba652ec45] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:17.598646 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bd64eb11-8f3e-4873-b45a-48d42b95aa16 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:17.599132 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bd64eb11-8f3e-4873-b45a-48d42b95aa16 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:17.599480 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-48f73ca7-7cdb-4f92-ba71-adbb259aed30 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:17.599581 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bd64eb11-8f3e-4873-b45a-48d42b95aa16 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:17.599952 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-48f73ca7-7cdb-4f92-ba71-adbb259aed30 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:17.600233 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bd64eb11-8f3e-4873-b45a-48d42b95aa16 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:17.600372 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-48f73ca7-7cdb-4f92-ba71-adbb259aed30 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:17.600684 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bd64eb11-8f3e-4873-b45a-48d42b95aa16 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:17.601050 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-48f73ca7-7cdb-4f92-ba71-adbb259aed30 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:17.601148 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bd64eb11-8f3e-4873-b45a-48d42b95aa16 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:17.601520 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-48f73ca7-7cdb-4f92-ba71-adbb259aed30 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:17.601934 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-48f73ca7-7cdb-4f92-ba71-adbb259aed30 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:17.740310 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-bd64eb11-8f3e-4873-b45a-48d42b95aa16 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:17.748978 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-48f73ca7-7cdb-4f92-ba71-adbb259aed30 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:17.753796 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-bd64eb11-8f3e-4873-b45a-48d42b95aa16 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1521 microversion: 2.1 time: 0.165385 Aug 31 19:14:17.754752 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 128/268] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:17 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:17.757682 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-48f73ca7-7cdb-4f92-ba71-adbb259aed30 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45" status: 200 len: 1314 microversion: 2.1 time: 0.169178 Aug 31 19:14:17.758311 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 141/269] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:17 2022] GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:14:17.839043 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-5883d0eb-c421-4f2e-a84a-aad1133785c6 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:17.840038 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-5883d0eb-c421-4f2e-a84a-aad1133785c6 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:17.846944 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5883d0eb-c421-4f2e-a84a-aad1133785c6 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:17.847415 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5883d0eb-c421-4f2e-a84a-aad1133785c6 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:17.847837 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5883d0eb-c421-4f2e-a84a-aad1133785c6 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:17.848507 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5883d0eb-c421-4f2e-a84a-aad1133785c6 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:17.848949 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5883d0eb-c421-4f2e-a84a-aad1133785c6 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:17.849523 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5883d0eb-c421-4f2e-a84a-aad1133785c6 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:17.981591 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-5883d0eb-c421-4f2e-a84a-aad1133785c6 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:17.990353 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-5883d0eb-c421-4f2e-a84a-aad1133785c6 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1553 microversion: 2.1 time: 0.155111 Aug 31 19:14:17.990907 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 129/270] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:17 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:18.775463 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-10673bdd-185c-4065-899d-ee02fc1423e4 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:18.777294 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-10673bdd-185c-4065-899d-ee02fc1423e4 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:18.784400 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-10673bdd-185c-4065-899d-ee02fc1423e4 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:18.784965 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-10673bdd-185c-4065-899d-ee02fc1423e4 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:18.785364 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-10673bdd-185c-4065-899d-ee02fc1423e4 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:18.786260 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-10673bdd-185c-4065-899d-ee02fc1423e4 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:18.786767 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-9ec06201-ae7c-4ab9-9688-4d437599d134 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:18.787390 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-10673bdd-185c-4065-899d-ee02fc1423e4 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:18.787943 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-9ec06201-ae7c-4ab9-9688-4d437599d134 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 7631e09a-0908-4af8-960d-bb7ba652ec45] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:18.788124 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-10673bdd-185c-4065-899d-ee02fc1423e4 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:18.796965 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9ec06201-ae7c-4ab9-9688-4d437599d134 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:18.798163 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9ec06201-ae7c-4ab9-9688-4d437599d134 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:18.798814 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9ec06201-ae7c-4ab9-9688-4d437599d134 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:18.799753 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9ec06201-ae7c-4ab9-9688-4d437599d134 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:18.800507 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9ec06201-ae7c-4ab9-9688-4d437599d134 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:18.801308 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9ec06201-ae7c-4ab9-9688-4d437599d134 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:18.982653 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-9ec06201-ae7c-4ab9-9688-4d437599d134 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:18.993860 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-9ec06201-ae7c-4ab9-9688-4d437599d134 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45" status: 200 len: 1314 microversion: 2.1 time: 0.216437 Aug 31 19:14:18.994999 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 130/271] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:18 2022] GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:19.016590 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-30981162-9cb6-46d3-a71f-bed2ab072107 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:19.019245 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-30981162-9cb6-46d3-a71f-bed2ab072107 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:19.032696 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-30981162-9cb6-46d3-a71f-bed2ab072107 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:19.037957 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-30981162-9cb6-46d3-a71f-bed2ab072107 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:19.039000 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-30981162-9cb6-46d3-a71f-bed2ab072107 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:19.039904 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-30981162-9cb6-46d3-a71f-bed2ab072107 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:19.040835 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-30981162-9cb6-46d3-a71f-bed2ab072107 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:19.042568 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-30981162-9cb6-46d3-a71f-bed2ab072107 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:19.052237 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-10673bdd-185c-4065-899d-ee02fc1423e4 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:19.063751 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-10673bdd-185c-4065-899d-ee02fc1423e4 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1521 microversion: 2.1 time: 0.292425 Aug 31 19:14:19.064516 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 142/272] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:18 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1521 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:19.242697 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-30981162-9cb6-46d3-a71f-bed2ab072107 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:19.256589 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-30981162-9cb6-46d3-a71f-bed2ab072107 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1553 microversion: 2.1 time: 0.241335 Aug 31 19:14:19.256589 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 131/273] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:19 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1553 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:20.021586 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-c277ddd5-a3ba-4d38-bab0-651c4ede427d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:20.022585 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-c277ddd5-a3ba-4d38-bab0-651c4ede427d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 7631e09a-0908-4af8-960d-bb7ba652ec45] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:20.035066 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c277ddd5-a3ba-4d38-bab0-651c4ede427d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:20.037884 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c277ddd5-a3ba-4d38-bab0-651c4ede427d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:20.040697 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c277ddd5-a3ba-4d38-bab0-651c4ede427d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:20.042154 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c277ddd5-a3ba-4d38-bab0-651c4ede427d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:20.042788 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c277ddd5-a3ba-4d38-bab0-651c4ede427d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:20.043408 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c277ddd5-a3ba-4d38-bab0-651c4ede427d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:20.086295 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-34eecc1e-d709-40be-b661-8655bd0c6c56 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:20.086839 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-34eecc1e-d709-40be-b661-8655bd0c6c56 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:20.093613 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-34eecc1e-d709-40be-b661-8655bd0c6c56 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:20.094107 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-34eecc1e-d709-40be-b661-8655bd0c6c56 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:20.094549 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-34eecc1e-d709-40be-b661-8655bd0c6c56 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:20.095247 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-34eecc1e-d709-40be-b661-8655bd0c6c56 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:20.095704 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-34eecc1e-d709-40be-b661-8655bd0c6c56 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:20.096129 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-34eecc1e-d709-40be-b661-8655bd0c6c56 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:20.319342 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-34eecc1e-d709-40be-b661-8655bd0c6c56 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:20.332362 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-34eecc1e-d709-40be-b661-8655bd0c6c56 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1521 microversion: 2.1 time: 0.249866 Aug 31 19:14:20.337483 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 132/274] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:20 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:14:20.354006 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d3253561-7a89-47bb-aff6-2a80c1998111 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:20.355402 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d3253561-7a89-47bb-aff6-2a80c1998111 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:20.364879 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-c277ddd5-a3ba-4d38-bab0-651c4ede427d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:20.367092 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d3253561-7a89-47bb-aff6-2a80c1998111 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:20.369380 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d3253561-7a89-47bb-aff6-2a80c1998111 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:20.369824 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d3253561-7a89-47bb-aff6-2a80c1998111 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:20.373575 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d3253561-7a89-47bb-aff6-2a80c1998111 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:20.374002 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d3253561-7a89-47bb-aff6-2a80c1998111 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:20.374442 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d3253561-7a89-47bb-aff6-2a80c1998111 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:20.377937 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-c277ddd5-a3ba-4d38-bab0-651c4ede427d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45" status: 200 len: 1314 microversion: 2.1 time: 0.365055 Aug 31 19:14:20.379083 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 143/275] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:20 2022] GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45 => generated 1314 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:20.611967 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-d3253561-7a89-47bb-aff6-2a80c1998111 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:20.623054 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-d3253561-7a89-47bb-aff6-2a80c1998111 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1553 microversion: 2.1 time: 0.282358 Aug 31 19:14:20.623817 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 133/276] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:20 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1553 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:21.363486 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-e1434403-d183-4fe8-861b-9e677bf6157d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:21.364780 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-e1434403-d183-4fe8-861b-9e677bf6157d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:21.371411 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e1434403-d183-4fe8-861b-9e677bf6157d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:21.372201 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e1434403-d183-4fe8-861b-9e677bf6157d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:21.372746 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e1434403-d183-4fe8-861b-9e677bf6157d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:21.373626 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e1434403-d183-4fe8-861b-9e677bf6157d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:21.374226 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e1434403-d183-4fe8-861b-9e677bf6157d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:21.374736 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e1434403-d183-4fe8-861b-9e677bf6157d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:21.402440 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-954aa9a8-3164-4f37-996d-2f0908015b32 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:21.404131 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-954aa9a8-3164-4f37-996d-2f0908015b32 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 7631e09a-0908-4af8-960d-bb7ba652ec45] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:21.413557 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-954aa9a8-3164-4f37-996d-2f0908015b32 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:21.414726 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-954aa9a8-3164-4f37-996d-2f0908015b32 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:21.415240 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-954aa9a8-3164-4f37-996d-2f0908015b32 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:21.415954 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-954aa9a8-3164-4f37-996d-2f0908015b32 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:21.416433 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-954aa9a8-3164-4f37-996d-2f0908015b32 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:21.416832 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-954aa9a8-3164-4f37-996d-2f0908015b32 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:21.581697 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-954aa9a8-3164-4f37-996d-2f0908015b32 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:21.607398 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-954aa9a8-3164-4f37-996d-2f0908015b32 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45" status: 200 len: 1314 microversion: 2.1 time: 0.210987 Aug 31 19:14:21.608414 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 134/277] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:21 2022] GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45 => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:21.664305 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-abf0ff52-df31-42e1-9e0c-773fa449c9ce tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:21.670247 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-abf0ff52-df31-42e1-9e0c-773fa449c9ce tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:21.677764 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-abf0ff52-df31-42e1-9e0c-773fa449c9ce tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:21.678586 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-abf0ff52-df31-42e1-9e0c-773fa449c9ce tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:21.679526 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-abf0ff52-df31-42e1-9e0c-773fa449c9ce tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:21.680491 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-abf0ff52-df31-42e1-9e0c-773fa449c9ce tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:21.681150 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-abf0ff52-df31-42e1-9e0c-773fa449c9ce tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:21.682108 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-abf0ff52-df31-42e1-9e0c-773fa449c9ce tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:21.688764 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-e1434403-d183-4fe8-861b-9e677bf6157d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:21.699952 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-e1434403-d183-4fe8-861b-9e677bf6157d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1521 microversion: 2.1 time: 0.340472 Aug 31 19:14:21.701123 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 144/278] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:21 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1521 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:21.858928 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-abf0ff52-df31-42e1-9e0c-773fa449c9ce tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:21.871433 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-abf0ff52-df31-42e1-9e0c-773fa449c9ce tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1553 microversion: 2.1 time: 0.228647 Aug 31 19:14:21.873263 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 135/279] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:21 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1553 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:14:22.633458 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-48f47bb0-3083-4615-8835-a0c978fb5ae3 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:22.636939 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-48f47bb0-3083-4615-8835-a0c978fb5ae3 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 7631e09a-0908-4af8-960d-bb7ba652ec45] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:22.644216 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-48f47bb0-3083-4615-8835-a0c978fb5ae3 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:22.645324 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-48f47bb0-3083-4615-8835-a0c978fb5ae3 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:22.646005 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-48f47bb0-3083-4615-8835-a0c978fb5ae3 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:22.646846 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-48f47bb0-3083-4615-8835-a0c978fb5ae3 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:22.647457 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-48f47bb0-3083-4615-8835-a0c978fb5ae3 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:22.648020 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-48f47bb0-3083-4615-8835-a0c978fb5ae3 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:22.721829 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-075067ba-dee2-4cef-8cc7-0ac3a07c17f0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:22.726880 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-075067ba-dee2-4cef-8cc7-0ac3a07c17f0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:22.738138 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-075067ba-dee2-4cef-8cc7-0ac3a07c17f0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:22.738635 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-075067ba-dee2-4cef-8cc7-0ac3a07c17f0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:22.739072 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-075067ba-dee2-4cef-8cc7-0ac3a07c17f0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:22.739781 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-075067ba-dee2-4cef-8cc7-0ac3a07c17f0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:22.740238 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-075067ba-dee2-4cef-8cc7-0ac3a07c17f0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:22.740661 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-075067ba-dee2-4cef-8cc7-0ac3a07c17f0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:22.847019 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-48f47bb0-3083-4615-8835-a0c978fb5ae3 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:22.857268 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-48f47bb0-3083-4615-8835-a0c978fb5ae3 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45" status: 200 len: 1314 microversion: 2.1 time: 0.229649 Aug 31 19:14:22.860101 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 145/280] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:22 2022] GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:22.895952 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-6bd63558-e751-4c84-9845-a36cdbe642e5 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:22.897501 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-6bd63558-e751-4c84-9845-a36cdbe642e5 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:22.905342 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6bd63558-e751-4c84-9845-a36cdbe642e5 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:22.906253 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6bd63558-e751-4c84-9845-a36cdbe642e5 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:22.906848 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6bd63558-e751-4c84-9845-a36cdbe642e5 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:22.907901 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6bd63558-e751-4c84-9845-a36cdbe642e5 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:22.908357 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6bd63558-e751-4c84-9845-a36cdbe642e5 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:22.908781 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6bd63558-e751-4c84-9845-a36cdbe642e5 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:23.088758 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-075067ba-dee2-4cef-8cc7-0ac3a07c17f0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:23.099119 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-075067ba-dee2-4cef-8cc7-0ac3a07c17f0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1521 microversion: 2.1 time: 0.380936 Aug 31 19:14:23.103648 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 136/281] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:22 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1521 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:23.142823 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-6bd63558-e751-4c84-9845-a36cdbe642e5 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:23.152372 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-6bd63558-e751-4c84-9845-a36cdbe642e5 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1553 microversion: 2.1 time: 0.261094 Aug 31 19:14:23.158004 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 146/282] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:22 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1553 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:14:23.880195 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-b6c91937-b4c4-4f29-b363-5b643da45e09 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:23.880971 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-b6c91937-b4c4-4f29-b363-5b643da45e09 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 7631e09a-0908-4af8-960d-bb7ba652ec45] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:23.887712 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b6c91937-b4c4-4f29-b363-5b643da45e09 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:23.888431 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b6c91937-b4c4-4f29-b363-5b643da45e09 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:23.889019 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b6c91937-b4c4-4f29-b363-5b643da45e09 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:23.889731 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b6c91937-b4c4-4f29-b363-5b643da45e09 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:23.890170 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b6c91937-b4c4-4f29-b363-5b643da45e09 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:23.890785 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b6c91937-b4c4-4f29-b363-5b643da45e09 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:24.114644 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-b6c91937-b4c4-4f29-b363-5b643da45e09 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:24.123418 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-b6c91937-b4c4-4f29-b363-5b643da45e09 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45" status: 200 len: 1314 microversion: 2.1 time: 0.247169 Aug 31 19:14:24.124077 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 137/283] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:23 2022] GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:24.138162 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-1daed3cd-8475-4031-8ba4-e19d28e8c29f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:24.138924 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-1daed3cd-8475-4031-8ba4-e19d28e8c29f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:24.145670 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1daed3cd-8475-4031-8ba4-e19d28e8c29f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:24.146794 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1daed3cd-8475-4031-8ba4-e19d28e8c29f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:24.147234 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1daed3cd-8475-4031-8ba4-e19d28e8c29f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:24.147948 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1daed3cd-8475-4031-8ba4-e19d28e8c29f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:24.148405 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1daed3cd-8475-4031-8ba4-e19d28e8c29f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:24.148836 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1daed3cd-8475-4031-8ba4-e19d28e8c29f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:24.173489 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-282912a4-8436-4873-8984-df6c01fa6252 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:24.174388 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-282912a4-8436-4873-8984-df6c01fa6252 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:24.181856 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-282912a4-8436-4873-8984-df6c01fa6252 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:24.182798 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-282912a4-8436-4873-8984-df6c01fa6252 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:24.183405 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-282912a4-8436-4873-8984-df6c01fa6252 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:24.184114 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-282912a4-8436-4873-8984-df6c01fa6252 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:24.184645 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-282912a4-8436-4873-8984-df6c01fa6252 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:24.185356 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-282912a4-8436-4873-8984-df6c01fa6252 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:24.379961 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-1daed3cd-8475-4031-8ba4-e19d28e8c29f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:24.396360 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-1daed3cd-8475-4031-8ba4-e19d28e8c29f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1521 microversion: 2.1 time: 0.276355 Aug 31 19:14:24.404300 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 147/284] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:24 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1521 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:14:24.546307 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-282912a4-8436-4873-8984-df6c01fa6252 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:24.556538 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-282912a4-8436-4873-8984-df6c01fa6252 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1553 microversion: 2.1 time: 0.387979 Aug 31 19:14:24.558775 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 138/285] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:24 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1553 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:14:25.146167 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-b6a6a0b8-f06c-4506-a5a0-51d50239f10c tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:25.147350 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-b6a6a0b8-f06c-4506-a5a0-51d50239f10c tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 7631e09a-0908-4af8-960d-bb7ba652ec45] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:25.154287 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b6a6a0b8-f06c-4506-a5a0-51d50239f10c tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:25.154778 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b6a6a0b8-f06c-4506-a5a0-51d50239f10c tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:25.155273 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b6a6a0b8-f06c-4506-a5a0-51d50239f10c tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:25.155957 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b6a6a0b8-f06c-4506-a5a0-51d50239f10c tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:25.156481 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b6a6a0b8-f06c-4506-a5a0-51d50239f10c tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:25.156915 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b6a6a0b8-f06c-4506-a5a0-51d50239f10c tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:25.346042 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-b6a6a0b8-f06c-4506-a5a0-51d50239f10c tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:25.357597 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-b6a6a0b8-f06c-4506-a5a0-51d50239f10c tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45" status: 200 len: 1314 microversion: 2.1 time: 0.217402 Aug 31 19:14:25.358879 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 148/286] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:25 2022] GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:25.417119 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-6995d045-af9f-4401-8700-de1e95fa2656 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:25.418443 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-6995d045-af9f-4401-8700-de1e95fa2656 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:25.427463 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6995d045-af9f-4401-8700-de1e95fa2656 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:25.428008 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6995d045-af9f-4401-8700-de1e95fa2656 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:25.428468 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6995d045-af9f-4401-8700-de1e95fa2656 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:25.429391 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6995d045-af9f-4401-8700-de1e95fa2656 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:25.430337 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6995d045-af9f-4401-8700-de1e95fa2656 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:25.430767 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6995d045-af9f-4401-8700-de1e95fa2656 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:25.576135 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-6995d045-af9f-4401-8700-de1e95fa2656 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:25.580286 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-82b84612-e528-4066-ac3d-800201917173 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:25.581294 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-82b84612-e528-4066-ac3d-800201917173 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:25.585987 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-6995d045-af9f-4401-8700-de1e95fa2656 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1521 microversion: 2.1 time: 0.172973 Aug 31 19:14:25.586773 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 139/287] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:25 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:25.589548 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-82b84612-e528-4066-ac3d-800201917173 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:25.590037 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-82b84612-e528-4066-ac3d-800201917173 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:25.590467 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-82b84612-e528-4066-ac3d-800201917173 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:25.591159 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-82b84612-e528-4066-ac3d-800201917173 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:25.591609 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-82b84612-e528-4066-ac3d-800201917173 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:25.592024 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-82b84612-e528-4066-ac3d-800201917173 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:25.811812 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-82b84612-e528-4066-ac3d-800201917173 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:25.821175 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-82b84612-e528-4066-ac3d-800201917173 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1553 microversion: 2.1 time: 0.244756 Aug 31 19:14:25.822072 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 149/288] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:25 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1553 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:14:26.380760 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-c6e3f3aa-4463-408f-9c67-ab452287d3b2 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:26.382225 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-c6e3f3aa-4463-408f-9c67-ab452287d3b2 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 7631e09a-0908-4af8-960d-bb7ba652ec45] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:26.393416 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c6e3f3aa-4463-408f-9c67-ab452287d3b2 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:26.394251 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c6e3f3aa-4463-408f-9c67-ab452287d3b2 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:26.396858 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c6e3f3aa-4463-408f-9c67-ab452287d3b2 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:26.397690 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c6e3f3aa-4463-408f-9c67-ab452287d3b2 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:26.398237 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c6e3f3aa-4463-408f-9c67-ab452287d3b2 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:26.399109 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c6e3f3aa-4463-408f-9c67-ab452287d3b2 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:26.587293 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-c6e3f3aa-4463-408f-9c67-ab452287d3b2 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:26.592873 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:14:26.598472 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-c6e3f3aa-4463-408f-9c67-ab452287d3b2 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45" status: 200 len: 1314 microversion: 2.1 time: 0.221947 Aug 31 19:14:26.599088 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 140/289] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:26 2022] GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:26.613495 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-2141c095-bece-4139-8815-f9a03be2386f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:26.614865 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-2141c095-bece-4139-8815-f9a03be2386f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:26.622609 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2141c095-bece-4139-8815-f9a03be2386f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:26.623081 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2141c095-bece-4139-8815-f9a03be2386f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:26.624333 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2141c095-bece-4139-8815-f9a03be2386f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:26.625097 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2141c095-bece-4139-8815-f9a03be2386f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:26.626874 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2141c095-bece-4139-8815-f9a03be2386f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:26.627825 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2141c095-bece-4139-8815-f9a03be2386f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:26.846231 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-73d3faee-52be-4367-b052-164f479bd333 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:26.847737 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-73d3faee-52be-4367-b052-164f479bd333 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:26.859036 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-2141c095-bece-4139-8815-f9a03be2386f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:26.870019 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-73d3faee-52be-4367-b052-164f479bd333 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:26.870648 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-2141c095-bece-4139-8815-f9a03be2386f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1521 microversion: 2.1 time: 0.263081 Aug 31 19:14:26.871483 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-73d3faee-52be-4367-b052-164f479bd333 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:26.871665 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 150/290] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:26 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:26.872350 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-73d3faee-52be-4367-b052-164f479bd333 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:26.873221 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-73d3faee-52be-4367-b052-164f479bd333 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:26.873947 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-73d3faee-52be-4367-b052-164f479bd333 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:26.875787 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-73d3faee-52be-4367-b052-164f479bd333 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:27.018482 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-e4b35ac9-418c-4fde-9409-9e044cac8283 req-583cb864-db23-417c-81c0-e7e431637136 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7631e09a-0908-4af8-960d-bb7ba652ec45", "name": "network-vif-plugged", "status": "completed", "tag": "d1d15f84-67e7-4f44-bb8a-4f9b57959e72"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:14:27.051006 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-e4b35ac9-418c-4fde-9409-9e044cac8283 req-583cb864-db23-417c-81c0-e7e431637136 service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:27.051703 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-e4b35ac9-418c-4fde-9409-9e044cac8283 req-583cb864-db23-417c-81c0-e7e431637136 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:27.053342 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-e4b35ac9-418c-4fde-9409-9e044cac8283 req-583cb864-db23-417c-81c0-e7e431637136 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:27.079899 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-73d3faee-52be-4367-b052-164f479bd333 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:27.094745 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-73d3faee-52be-4367-b052-164f479bd333 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1553 microversion: 2.1 time: 0.254135 Aug 31 19:14:27.111728 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 141/291] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:26 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1553 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:27.367345 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-e4b35ac9-418c-4fde-9409-9e044cac8283 req-583cb864-db23-417c-81c0-e7e431637136 service nova] Creating event network-vif-plugged:d1d15f84-67e7-4f44-bb8a-4f9b57959e72 for instance 7631e09a-0908-4af8-960d-bb7ba652ec45 on hv-cinder-83538 Aug 31 19:14:27.376693 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-e4b35ac9-418c-4fde-9409-9e044cac8283 req-583cb864-db23-417c-81c0-e7e431637136 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.370861 Aug 31 19:14:27.397378 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 151/292] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:14:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:14:27.624420 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-07f5ddbe-b196-4eef-beff-46a37d6d7f09 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:27.625533 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-07f5ddbe-b196-4eef-beff-46a37d6d7f09 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 7631e09a-0908-4af8-960d-bb7ba652ec45] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:27.637491 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-07f5ddbe-b196-4eef-beff-46a37d6d7f09 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:27.638782 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-07f5ddbe-b196-4eef-beff-46a37d6d7f09 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:27.639962 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-07f5ddbe-b196-4eef-beff-46a37d6d7f09 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:27.642225 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-07f5ddbe-b196-4eef-beff-46a37d6d7f09 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:27.643141 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-07f5ddbe-b196-4eef-beff-46a37d6d7f09 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:27.643782 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-07f5ddbe-b196-4eef-beff-46a37d6d7f09 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:27.791190 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-07f5ddbe-b196-4eef-beff-46a37d6d7f09 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:27.805800 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-07f5ddbe-b196-4eef-beff-46a37d6d7f09 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45" status: 200 len: 1314 microversion: 2.1 time: 0.186687 Aug 31 19:14:27.807764 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 142/293] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:27 2022] GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:27.893887 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-3af550ef-8fe2-4c18-8c5d-8716ea25608a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:27.894894 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-3af550ef-8fe2-4c18-8c5d-8716ea25608a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:27.905119 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3af550ef-8fe2-4c18-8c5d-8716ea25608a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:27.905930 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3af550ef-8fe2-4c18-8c5d-8716ea25608a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:27.906613 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3af550ef-8fe2-4c18-8c5d-8716ea25608a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:27.907809 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3af550ef-8fe2-4c18-8c5d-8716ea25608a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:27.908332 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3af550ef-8fe2-4c18-8c5d-8716ea25608a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:27.908977 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3af550ef-8fe2-4c18-8c5d-8716ea25608a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:28.116022 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-43439d20-17df-43ca-b3c3-0b71e7bce471 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:28.116908 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-43439d20-17df-43ca-b3c3-0b71e7bce471 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:28.124459 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-43439d20-17df-43ca-b3c3-0b71e7bce471 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:28.125828 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-43439d20-17df-43ca-b3c3-0b71e7bce471 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:28.126421 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-43439d20-17df-43ca-b3c3-0b71e7bce471 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:28.127268 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-43439d20-17df-43ca-b3c3-0b71e7bce471 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:28.128632 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-43439d20-17df-43ca-b3c3-0b71e7bce471 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:28.129315 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-43439d20-17df-43ca-b3c3-0b71e7bce471 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:28.182526 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-3af550ef-8fe2-4c18-8c5d-8716ea25608a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:28.219450 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-3af550ef-8fe2-4c18-8c5d-8716ea25608a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1521 microversion: 2.1 time: 0.331663 Aug 31 19:14:28.220589 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 152/294] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:27 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1521 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:28.449595 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-43439d20-17df-43ca-b3c3-0b71e7bce471 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:28.462003 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-43439d20-17df-43ca-b3c3-0b71e7bce471 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1553 microversion: 2.1 time: 0.349802 Aug 31 19:14:28.462587 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 143/295] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:28 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1553 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:14:28.827529 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-d44c955b-57da-47ad-8abe-e41c473eff0d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:28.828407 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-d44c955b-57da-47ad-8abe-e41c473eff0d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 7631e09a-0908-4af8-960d-bb7ba652ec45] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:28.841671 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d44c955b-57da-47ad-8abe-e41c473eff0d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:28.842413 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d44c955b-57da-47ad-8abe-e41c473eff0d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:28.842995 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d44c955b-57da-47ad-8abe-e41c473eff0d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:28.843856 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d44c955b-57da-47ad-8abe-e41c473eff0d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:28.844456 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d44c955b-57da-47ad-8abe-e41c473eff0d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:28.845024 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d44c955b-57da-47ad-8abe-e41c473eff0d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:29.077405 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-d44c955b-57da-47ad-8abe-e41c473eff0d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:29.081373 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=100 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:14:29.087374 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-d44c955b-57da-47ad-8abe-e41c473eff0d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45" status: 200 len: 1314 microversion: 2.1 time: 0.263624 Aug 31 19:14:29.090210 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 153/296] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:28 2022] GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45 => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:29.248558 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-0304ccfd-2027-49bc-a2bf-367280deea61 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:29.249467 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-0304ccfd-2027-49bc-a2bf-367280deea61 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:29.262545 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0304ccfd-2027-49bc-a2bf-367280deea61 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:29.264795 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0304ccfd-2027-49bc-a2bf-367280deea61 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:29.265423 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0304ccfd-2027-49bc-a2bf-367280deea61 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:29.269283 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0304ccfd-2027-49bc-a2bf-367280deea61 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:29.269283 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0304ccfd-2027-49bc-a2bf-367280deea61 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:29.270926 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0304ccfd-2027-49bc-a2bf-367280deea61 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:29.486259 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-ff68d85a-2de7-4500-89fa-0766e03fbee3 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:29.486978 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-ff68d85a-2de7-4500-89fa-0766e03fbee3 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:29.503046 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ff68d85a-2de7-4500-89fa-0766e03fbee3 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:29.513946 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ff68d85a-2de7-4500-89fa-0766e03fbee3 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:29.514810 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ff68d85a-2de7-4500-89fa-0766e03fbee3 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:29.516228 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ff68d85a-2de7-4500-89fa-0766e03fbee3 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:29.516955 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ff68d85a-2de7-4500-89fa-0766e03fbee3 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:29.518168 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ff68d85a-2de7-4500-89fa-0766e03fbee3 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:29.647431 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-0304ccfd-2027-49bc-a2bf-367280deea61 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:29.658567 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-0304ccfd-2027-49bc-a2bf-367280deea61 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1521 microversion: 2.1 time: 0.414215 Aug 31 19:14:29.659158 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 144/297] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:29 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1521 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:29.736116 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-ff68d85a-2de7-4500-89fa-0766e03fbee3 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:29.749121 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-ff68d85a-2de7-4500-89fa-0766e03fbee3 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1553 microversion: 2.1 time: 0.268350 Aug 31 19:14:29.751150 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 154/298] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:29 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1553 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:30.115029 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-7eed9af5-0600-46e4-af40-888933e3befb tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:30.116022 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-7eed9af5-0600-46e4-af40-888933e3befb tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 7631e09a-0908-4af8-960d-bb7ba652ec45] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:30.124796 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7eed9af5-0600-46e4-af40-888933e3befb tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:30.126040 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7eed9af5-0600-46e4-af40-888933e3befb tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:30.127171 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7eed9af5-0600-46e4-af40-888933e3befb tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:30.128496 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7eed9af5-0600-46e4-af40-888933e3befb tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:30.129051 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7eed9af5-0600-46e4-af40-888933e3befb tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:30.129576 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7eed9af5-0600-46e4-af40-888933e3befb tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:30.367221 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-7eed9af5-0600-46e4-af40-888933e3befb tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:30.381408 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-7eed9af5-0600-46e4-af40-888933e3befb tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45" status: 200 len: 1314 microversion: 2.1 time: 0.274723 Aug 31 19:14:30.396822 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 145/299] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:30 2022] GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45 => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:30.688756 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-95acc27e-12cc-4b71-8707-0b2c7a61e564 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:30.689418 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-95acc27e-12cc-4b71-8707-0b2c7a61e564 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:30.696316 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-95acc27e-12cc-4b71-8707-0b2c7a61e564 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:30.697020 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-95acc27e-12cc-4b71-8707-0b2c7a61e564 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:30.698357 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-95acc27e-12cc-4b71-8707-0b2c7a61e564 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:30.699077 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-95acc27e-12cc-4b71-8707-0b2c7a61e564 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:30.699534 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-95acc27e-12cc-4b71-8707-0b2c7a61e564 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:30.700003 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-95acc27e-12cc-4b71-8707-0b2c7a61e564 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:30.774788 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-815aff94-117d-461a-ba84-e2ed8ea2de76 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:30.777033 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-815aff94-117d-461a-ba84-e2ed8ea2de76 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:30.785778 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-815aff94-117d-461a-ba84-e2ed8ea2de76 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:30.786580 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-815aff94-117d-461a-ba84-e2ed8ea2de76 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:30.787167 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-815aff94-117d-461a-ba84-e2ed8ea2de76 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:30.788133 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-815aff94-117d-461a-ba84-e2ed8ea2de76 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:30.788643 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-815aff94-117d-461a-ba84-e2ed8ea2de76 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:30.789316 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-815aff94-117d-461a-ba84-e2ed8ea2de76 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:30.946278 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-95acc27e-12cc-4b71-8707-0b2c7a61e564 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:30.963815 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-95acc27e-12cc-4b71-8707-0b2c7a61e564 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1521 microversion: 2.1 time: 0.284415 Aug 31 19:14:30.966246 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 155/300] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:30 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:31.097522 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-815aff94-117d-461a-ba84-e2ed8ea2de76 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:31.108797 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-815aff94-117d-461a-ba84-e2ed8ea2de76 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1553 microversion: 2.1 time: 0.338674 Aug 31 19:14:31.109418 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 146/301] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:30 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1553 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:31.400473 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-58ca18d3-65aa-4cbc-bb30-0a97a6d57864 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Action: 'create', calling method: .version_select at 0x7fdb865f7ca0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1231074008", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAOZB4uZTmj+OABm1drfRI9HefmJ1ev7ORCoQUME+Db/7tGnxRgGk5anqp+72DPy+y6VQlXR4M+MWRl5h/CLQCKcl1RV0CcwwujX9iMlvxYaue5MPjNE3OYDmbZ13SrnnQ=="}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:14:31.401938 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-c9c04600-4ccb-4605-bac1-74afac9d8831 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:31.402576 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-c9c04600-4ccb-4605-bac1-74afac9d8831 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 7631e09a-0908-4af8-960d-bb7ba652ec45] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:31.408931 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c9c04600-4ccb-4605-bac1-74afac9d8831 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:31.409588 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c9c04600-4ccb-4605-bac1-74afac9d8831 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:31.410071 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c9c04600-4ccb-4605-bac1-74afac9d8831 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:31.410718 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c9c04600-4ccb-4605-bac1-74afac9d8831 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:31.411283 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c9c04600-4ccb-4605-bac1-74afac9d8831 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:31.411592 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c9c04600-4ccb-4605-bac1-74afac9d8831 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:31.416945 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-58ca18d3-65aa-4cbc-bb30-0a97a6d57864 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Getting quotas for project fe3b687e68734a8888291f0c3527acbc. Resources: {'key_pairs'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:14:31.421573 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-58ca18d3-65aa-4cbc-bb30-0a97a6d57864 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Getting quotas for user 26cd75e2c118412a88bb354e18863d34 and project fe3b687e68734a8888291f0c3527acbc. Resources: {'key_pairs'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:14:31.445115 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-58ca18d3-65aa-4cbc-bb30-0a97a6d57864 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.216766 Aug 31 19:14:31.445776 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 156/302] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Aug 31 19:14:31 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:14:31.552365 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-c9c04600-4ccb-4605-bac1-74afac9d8831 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:31.561484 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-c9c04600-4ccb-4605-bac1-74afac9d8831 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45" status: 200 len: 1314 microversion: 2.1 time: 0.163307 Aug 31 19:14:31.562060 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 147/303] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:31 2022] GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:14:31.987501 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-d7d4d42b-52fd-4b45-bc53-e07f02300aa7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:31.988184 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-d7d4d42b-52fd-4b45-bc53-e07f02300aa7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:31.995615 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d7d4d42b-52fd-4b45-bc53-e07f02300aa7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:31.996498 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d7d4d42b-52fd-4b45-bc53-e07f02300aa7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:31.997104 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d7d4d42b-52fd-4b45-bc53-e07f02300aa7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:31.998006 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d7d4d42b-52fd-4b45-bc53-e07f02300aa7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:31.998657 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d7d4d42b-52fd-4b45-bc53-e07f02300aa7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:31.999228 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d7d4d42b-52fd-4b45-bc53-e07f02300aa7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:32.131925 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-3e43a9f1-7709-4cc4-8120-e7726c7691ba tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:32.132535 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-3e43a9f1-7709-4cc4-8120-e7726c7691ba tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:32.143916 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3e43a9f1-7709-4cc4-8120-e7726c7691ba tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:32.145164 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3e43a9f1-7709-4cc4-8120-e7726c7691ba tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:32.145701 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3e43a9f1-7709-4cc4-8120-e7726c7691ba tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:32.146481 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3e43a9f1-7709-4cc4-8120-e7726c7691ba tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:32.146943 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3e43a9f1-7709-4cc4-8120-e7726c7691ba tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:32.147411 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3e43a9f1-7709-4cc4-8120-e7726c7691ba tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:32.156429 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-d7d4d42b-52fd-4b45-bc53-e07f02300aa7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:32.164572 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-d7d4d42b-52fd-4b45-bc53-e07f02300aa7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1521 microversion: 2.1 time: 0.181574 Aug 31 19:14:32.165439 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 157/304] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:31 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:32.306809 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-3e43a9f1-7709-4cc4-8120-e7726c7691ba tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:32.316450 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-3e43a9f1-7709-4cc4-8120-e7726c7691ba tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1553 microversion: 2.1 time: 0.188593 Aug 31 19:14:32.317112 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 148/305] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:32 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1553 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:32.582020 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-2c26681f-95a0-4071-bd7f-c5bee19c6788 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:32.582780 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-2c26681f-95a0-4071-bd7f-c5bee19c6788 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 7631e09a-0908-4af8-960d-bb7ba652ec45] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:32.589425 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2c26681f-95a0-4071-bd7f-c5bee19c6788 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:32.589909 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2c26681f-95a0-4071-bd7f-c5bee19c6788 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:32.590340 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2c26681f-95a0-4071-bd7f-c5bee19c6788 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:32.591028 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2c26681f-95a0-4071-bd7f-c5bee19c6788 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:32.591476 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2c26681f-95a0-4071-bd7f-c5bee19c6788 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:32.591894 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2c26681f-95a0-4071-bd7f-c5bee19c6788 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:32.751002 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-2c26681f-95a0-4071-bd7f-c5bee19c6788 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:32.759939 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-2c26681f-95a0-4071-bd7f-c5bee19c6788 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45" status: 200 len: 1314 microversion: 2.1 time: 0.181640 Aug 31 19:14:32.762688 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 158/306] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:32 2022] GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:33.190159 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-47a77559-61a6-4199-b9bb-cf974a596dd8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:33.191598 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-47a77559-61a6-4199-b9bb-cf974a596dd8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:33.207557 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-47a77559-61a6-4199-b9bb-cf974a596dd8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:33.208267 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-47a77559-61a6-4199-b9bb-cf974a596dd8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:33.209638 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-47a77559-61a6-4199-b9bb-cf974a596dd8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:33.212800 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-47a77559-61a6-4199-b9bb-cf974a596dd8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:33.215150 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-47a77559-61a6-4199-b9bb-cf974a596dd8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:33.215669 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-47a77559-61a6-4199-b9bb-cf974a596dd8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:33.339584 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-b7b89506-6b86-48df-887a-7b489a8f9c43 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:33.340409 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-b7b89506-6b86-48df-887a-7b489a8f9c43 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:33.350722 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b7b89506-6b86-48df-887a-7b489a8f9c43 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:33.351492 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b7b89506-6b86-48df-887a-7b489a8f9c43 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:33.351925 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b7b89506-6b86-48df-887a-7b489a8f9c43 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:33.352862 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b7b89506-6b86-48df-887a-7b489a8f9c43 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:33.353425 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b7b89506-6b86-48df-887a-7b489a8f9c43 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:33.354107 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b7b89506-6b86-48df-887a-7b489a8f9c43 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:33.585737 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-b7b89506-6b86-48df-887a-7b489a8f9c43 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:33.621689 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-b7b89506-6b86-48df-887a-7b489a8f9c43 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1553 microversion: 2.1 time: 0.286701 Aug 31 19:14:33.624872 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 159/307] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:33 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1553 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:33.659792 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-47a77559-61a6-4199-b9bb-cf974a596dd8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:33.675211 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-47a77559-61a6-4199-b9bb-cf974a596dd8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1521 microversion: 2.1 time: 0.489992 Aug 31 19:14:33.676056 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 149/308] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:33 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1521 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:33.792789 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-44644c47-4b58-40c5-a9ab-702906ec5f99 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:33.793541 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-44644c47-4b58-40c5-a9ab-702906ec5f99 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 7631e09a-0908-4af8-960d-bb7ba652ec45] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:33.809464 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-44644c47-4b58-40c5-a9ab-702906ec5f99 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:33.811023 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-44644c47-4b58-40c5-a9ab-702906ec5f99 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:33.811877 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-44644c47-4b58-40c5-a9ab-702906ec5f99 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:33.812845 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-44644c47-4b58-40c5-a9ab-702906ec5f99 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:33.813515 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-44644c47-4b58-40c5-a9ab-702906ec5f99 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:33.814141 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-44644c47-4b58-40c5-a9ab-702906ec5f99 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:34.050895 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-44644c47-4b58-40c5-a9ab-702906ec5f99 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:34.064040 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-44644c47-4b58-40c5-a9ab-702906ec5f99 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45" status: 200 len: 1314 microversion: 2.1 time: 0.278415 Aug 31 19:14:34.082797 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 160/309] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:33 2022] GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45 => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:34.133732 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-8717a63d-56cf-4058-a7fa-49c7ea940e8c req-80451042-d565-4430-8bc4-120da6b55c94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9141c1ef-36d3-4d8c-bd46-8045891fe3c2", "name": "network-vif-deleted", "tag": "54772a5e-157f-44ed-b49a-99e7be75af5e"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:14:34.145479 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-8717a63d-56cf-4058-a7fa-49c7ea940e8c req-80451042-d565-4430-8bc4-120da6b55c94 service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:34.145960 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-8717a63d-56cf-4058-a7fa-49c7ea940e8c req-80451042-d565-4430-8bc4-120da6b55c94 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:34.146599 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-8717a63d-56cf-4058-a7fa-49c7ea940e8c req-80451042-d565-4430-8bc4-120da6b55c94 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:34.160016 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-8717a63d-56cf-4058-a7fa-49c7ea940e8c req-80451042-d565-4430-8bc4-120da6b55c94 service nova] Creating event network-vif-deleted:54772a5e-157f-44ed-b49a-99e7be75af5e for instance 9141c1ef-36d3-4d8c-bd46-8045891fe3c2 on hv-cinder-83538 Aug 31 19:14:34.184499 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-8717a63d-56cf-4058-a7fa-49c7ea940e8c req-80451042-d565-4430-8bc4-120da6b55c94 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055308 Aug 31 19:14:34.184862 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 150/310] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:14:34.646405 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-4baed19c-e000-48e6-994c-90bacec9d65a tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:34.647006 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-4baed19c-e000-48e6-994c-90bacec9d65a tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:34.668724 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4baed19c-e000-48e6-994c-90bacec9d65a tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:34.669746 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4baed19c-e000-48e6-994c-90bacec9d65a tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:34.670417 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4baed19c-e000-48e6-994c-90bacec9d65a tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:34.672391 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4baed19c-e000-48e6-994c-90bacec9d65a tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:34.673057 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4baed19c-e000-48e6-994c-90bacec9d65a tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:34.674122 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4baed19c-e000-48e6-994c-90bacec9d65a tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:34.698870 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-0cc90bf0-fe42-49c6-b934-6d0b2bbbe867 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:34.699591 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-0cc90bf0-fe42-49c6-b934-6d0b2bbbe867 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:34.709390 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0cc90bf0-fe42-49c6-b934-6d0b2bbbe867 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:34.709655 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0cc90bf0-fe42-49c6-b934-6d0b2bbbe867 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:34.710094 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0cc90bf0-fe42-49c6-b934-6d0b2bbbe867 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:34.710827 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0cc90bf0-fe42-49c6-b934-6d0b2bbbe867 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:34.711256 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0cc90bf0-fe42-49c6-b934-6d0b2bbbe867 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:34.711679 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0cc90bf0-fe42-49c6-b934-6d0b2bbbe867 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:34.889658 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-0cc90bf0-fe42-49c6-b934-6d0b2bbbe867 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:34.897776 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-0cc90bf0-fe42-49c6-b934-6d0b2bbbe867 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1521 microversion: 2.1 time: 0.204808 Aug 31 19:14:34.898358 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 151/311] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:34 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:34.968750 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-4baed19c-e000-48e6-994c-90bacec9d65a tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:34.976906 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-4baed19c-e000-48e6-994c-90bacec9d65a tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1511 microversion: 2.1 time: 0.334599 Aug 31 19:14:34.977496 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 161/312] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:34 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1511 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:35.083784 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-7a70a41f-dc83-4afc-a650-5bd103d58f84 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:35.084385 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-7a70a41f-dc83-4afc-a650-5bd103d58f84 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 7631e09a-0908-4af8-960d-bb7ba652ec45] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:35.090951 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7a70a41f-dc83-4afc-a650-5bd103d58f84 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:35.091440 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7a70a41f-dc83-4afc-a650-5bd103d58f84 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:35.091865 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7a70a41f-dc83-4afc-a650-5bd103d58f84 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:35.092563 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7a70a41f-dc83-4afc-a650-5bd103d58f84 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:35.093013 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7a70a41f-dc83-4afc-a650-5bd103d58f84 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:35.093553 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7a70a41f-dc83-4afc-a650-5bd103d58f84 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:35.381116 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-7a70a41f-dc83-4afc-a650-5bd103d58f84 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:35.389579 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-7a70a41f-dc83-4afc-a650-5bd103d58f84 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45" status: 200 len: 1314 microversion: 2.1 time: 0.309614 Aug 31 19:14:35.390151 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 152/313] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:35 2022] GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45 => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:35.919782 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-38468b3f-7613-4f8c-88fe-31b7bf239ac8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:35.920395 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-38468b3f-7613-4f8c-88fe-31b7bf239ac8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:35.926775 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-38468b3f-7613-4f8c-88fe-31b7bf239ac8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:35.927259 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-38468b3f-7613-4f8c-88fe-31b7bf239ac8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:35.927733 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-38468b3f-7613-4f8c-88fe-31b7bf239ac8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:35.928435 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-38468b3f-7613-4f8c-88fe-31b7bf239ac8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:35.928896 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-38468b3f-7613-4f8c-88fe-31b7bf239ac8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:35.929341 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-38468b3f-7613-4f8c-88fe-31b7bf239ac8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:35.999062 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e3e697b6-80e2-4042-9d05-08d23ef0bed4 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:35.999715 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-e3e697b6-80e2-4042-9d05-08d23ef0bed4 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:36.006574 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e3e697b6-80e2-4042-9d05-08d23ef0bed4 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:36.007503 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e3e697b6-80e2-4042-9d05-08d23ef0bed4 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:36.008163 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e3e697b6-80e2-4042-9d05-08d23ef0bed4 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:36.009366 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e3e697b6-80e2-4042-9d05-08d23ef0bed4 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:36.009514 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e3e697b6-80e2-4042-9d05-08d23ef0bed4 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:36.010121 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e3e697b6-80e2-4042-9d05-08d23ef0bed4 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:36.070216 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-38468b3f-7613-4f8c-88fe-31b7bf239ac8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:36.074990 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e3e697b6-80e2-4042-9d05-08d23ef0bed4 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:36.080056 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-38468b3f-7613-4f8c-88fe-31b7bf239ac8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1521 microversion: 2.1 time: 0.165154 Aug 31 19:14:36.080638 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 162/314] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:35 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:36.093786 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-e3e697b6-80e2-4042-9d05-08d23ef0bed4 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1345 microversion: 2.1 time: 0.099513 Aug 31 19:14:36.094361 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 153/315] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:35 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1345 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:14:36.412470 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-bfca9c22-318c-4e90-9fb1-ccce895dae28 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:36.413169 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-bfca9c22-318c-4e90-9fb1-ccce895dae28 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 7631e09a-0908-4af8-960d-bb7ba652ec45] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:36.420252 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bfca9c22-318c-4e90-9fb1-ccce895dae28 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:36.420820 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bfca9c22-318c-4e90-9fb1-ccce895dae28 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:36.421374 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bfca9c22-318c-4e90-9fb1-ccce895dae28 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:36.422310 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bfca9c22-318c-4e90-9fb1-ccce895dae28 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:36.422857 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bfca9c22-318c-4e90-9fb1-ccce895dae28 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:36.423345 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bfca9c22-318c-4e90-9fb1-ccce895dae28 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:36.581325 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-bfca9c22-318c-4e90-9fb1-ccce895dae28 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:36.590427 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-bfca9c22-318c-4e90-9fb1-ccce895dae28 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45" status: 200 len: 1314 microversion: 2.1 time: 0.182911 Aug 31 19:14:36.591307 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 163/316] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:36 2022] GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:37.100183 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-db89b3ef-ca1a-4cfe-b320-e6044849c1ac tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:37.101722 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-db89b3ef-ca1a-4cfe-b320-e6044849c1ac tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:37.110883 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-db89b3ef-ca1a-4cfe-b320-e6044849c1ac tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:37.111755 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-db89b3ef-ca1a-4cfe-b320-e6044849c1ac tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:37.112556 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-db89b3ef-ca1a-4cfe-b320-e6044849c1ac tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:37.113420 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-db89b3ef-ca1a-4cfe-b320-e6044849c1ac tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:37.114138 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-db89b3ef-ca1a-4cfe-b320-e6044849c1ac tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:37.121242 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-4c372e03-2ea9-4d6e-b378-4b1286f4dfd0 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:37.122752 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-4c372e03-2ea9-4d6e-b378-4b1286f4dfd0 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:37.129385 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-db89b3ef-ca1a-4cfe-b320-e6044849c1ac tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:37.134558 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4c372e03-2ea9-4d6e-b378-4b1286f4dfd0 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:37.137371 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4c372e03-2ea9-4d6e-b378-4b1286f4dfd0 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:37.138074 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4c372e03-2ea9-4d6e-b378-4b1286f4dfd0 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:37.139136 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4c372e03-2ea9-4d6e-b378-4b1286f4dfd0 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:37.141840 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4c372e03-2ea9-4d6e-b378-4b1286f4dfd0 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:37.142464 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4c372e03-2ea9-4d6e-b378-4b1286f4dfd0 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:37.186804 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4c372e03-2ea9-4d6e-b378-4b1286f4dfd0 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:37.187289 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4c372e03-2ea9-4d6e-b378-4b1286f4dfd0 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:37.187715 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4c372e03-2ea9-4d6e-b378-4b1286f4dfd0 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:37.188296 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.objects.instance [None req-4c372e03-2ea9-4d6e-b378-4b1286f4dfd0 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lazy-loading 'fault' on Instance uuid 9141c1ef-36d3-4d8c-bd46-8045891fe3c2 {{(pid=120624) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:14:37.242253 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-4c372e03-2ea9-4d6e-b378-4b1286f4dfd0 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:37.253721 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-4c372e03-2ea9-4d6e-b378-4b1286f4dfd0 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1350 microversion: 2.1 time: 0.137703 Aug 31 19:14:37.261656 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 164/317] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:37 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1350 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:37.286791 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-db89b3ef-ca1a-4cfe-b320-e6044849c1ac tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:37.295165 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-db89b3ef-ca1a-4cfe-b320-e6044849c1ac tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1501 microversion: 2.1 time: 0.199150 Aug 31 19:14:37.295709 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 154/318] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:37 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1501 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:37.314332 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-e8850435-78b1-42b7-9e08-2fa43e31ee7f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:37.314917 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-e8850435-78b1-42b7-9e08-2fa43e31ee7f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:37.320910 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e8850435-78b1-42b7-9e08-2fa43e31ee7f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:37.321456 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e8850435-78b1-42b7-9e08-2fa43e31ee7f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:37.321879 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e8850435-78b1-42b7-9e08-2fa43e31ee7f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:37.322624 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e8850435-78b1-42b7-9e08-2fa43e31ee7f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:37.323071 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e8850435-78b1-42b7-9e08-2fa43e31ee7f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:37.323536 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e8850435-78b1-42b7-9e08-2fa43e31ee7f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:37.457885 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-e8850435-78b1-42b7-9e08-2fa43e31ee7f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:37.466236 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-e8850435-78b1-42b7-9e08-2fa43e31ee7f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48" status: 200 len: 1515 microversion: 2.1 time: 0.155797 Aug 31 19:14:37.466982 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 165/319] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:37 2022] GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:37.613179 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-f049d76c-d769-4484-bd93-3c77a262f5ee tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:37.613881 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-f049d76c-d769-4484-bd93-3c77a262f5ee tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 7631e09a-0908-4af8-960d-bb7ba652ec45] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:37.625064 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f049d76c-d769-4484-bd93-3c77a262f5ee tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:37.628553 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f049d76c-d769-4484-bd93-3c77a262f5ee tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:37.630397 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f049d76c-d769-4484-bd93-3c77a262f5ee tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:37.631424 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f049d76c-d769-4484-bd93-3c77a262f5ee tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:37.634238 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f049d76c-d769-4484-bd93-3c77a262f5ee tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:37.634850 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f049d76c-d769-4484-bd93-3c77a262f5ee tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:37.856299 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-f049d76c-d769-4484-bd93-3c77a262f5ee tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:37.880284 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-f049d76c-d769-4484-bd93-3c77a262f5ee tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45" status: 200 len: 1498 microversion: 2.1 time: 0.270552 Aug 31 19:14:37.881170 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 155/320] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:37 2022] GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45 => generated 1498 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:38.277915 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-fd795f1c-a9dc-4997-898a-937b7f968c4e tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:38.280486 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-fd795f1c-a9dc-4997-898a-937b7f968c4e tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:38.288634 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fd795f1c-a9dc-4997-898a-937b7f968c4e tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:38.289343 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fd795f1c-a9dc-4997-898a-937b7f968c4e tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:38.290148 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fd795f1c-a9dc-4997-898a-937b7f968c4e tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:38.292054 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fd795f1c-a9dc-4997-898a-937b7f968c4e tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:38.292851 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fd795f1c-a9dc-4997-898a-937b7f968c4e tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:38.293471 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fd795f1c-a9dc-4997-898a-937b7f968c4e tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:38.333098 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fd795f1c-a9dc-4997-898a-937b7f968c4e tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:38.333628 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fd795f1c-a9dc-4997-898a-937b7f968c4e tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:38.334115 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fd795f1c-a9dc-4997-898a-937b7f968c4e tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:38.334568 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.objects.instance [None req-fd795f1c-a9dc-4997-898a-937b7f968c4e tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lazy-loading 'fault' on Instance uuid 9141c1ef-36d3-4d8c-bd46-8045891fe3c2 {{(pid=120624) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:14:38.417538 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-fd795f1c-a9dc-4997-898a-937b7f968c4e tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4869c70eac84fddb30090585bc1f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8782e8b0af4a2eb7335a0500716b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:38.441020 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-fd795f1c-a9dc-4997-898a-937b7f968c4e tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 200 len: 1350 microversion: 2.1 time: 0.168704 Aug 31 19:14:38.441917 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 166/321] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:38 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 1350 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:38.976696 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-90cdfad8-f582-478e-ae72-8e3329de97e1 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:14:38.979832 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-90cdfad8-f582-478e-ae72-8e3329de97e1 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:38.982149 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:14:38.987397 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-90cdfad8-f582-478e-ae72-8e3329de97e1 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:38.987983 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-90cdfad8-f582-478e-ae72-8e3329de97e1 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:38.988481 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-90cdfad8-f582-478e-ae72-8e3329de97e1 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:38.989263 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-90cdfad8-f582-478e-ae72-8e3329de97e1 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:38.989783 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-90cdfad8-f582-478e-ae72-8e3329de97e1 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:38.990270 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-90cdfad8-f582-478e-ae72-8e3329de97e1 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:39.020093 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.objects.instance [None req-90cdfad8-f582-478e-ae72-8e3329de97e1 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lazy-loading 'flavor' on Instance uuid 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 {{(pid=120623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:14:39.076271 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:14:39.112590 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-90cdfad8-f582-478e-ae72-8e3329de97e1 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "POST /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48/action" status: 200 len: 32 microversion: 2.1 time: 0.139625 Aug 31 19:14:39.113575 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 156/322] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 31 19:14:38 2022] POST /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48/action => generated 32 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 19:14:39.125489 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-44dcd5fc-2797-4670-b8c8-fb9ca73c3c16 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:39.126340 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-44dcd5fc-2797-4670-b8c8-fb9ca73c3c16 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:39.134448 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-44dcd5fc-2797-4670-b8c8-fb9ca73c3c16 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:39.135237 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-44dcd5fc-2797-4670-b8c8-fb9ca73c3c16 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:39.135889 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-44dcd5fc-2797-4670-b8c8-fb9ca73c3c16 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:39.136805 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-44dcd5fc-2797-4670-b8c8-fb9ca73c3c16 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:39.137609 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-44dcd5fc-2797-4670-b8c8-fb9ca73c3c16 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:39.138708 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-44dcd5fc-2797-4670-b8c8-fb9ca73c3c16 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:39.236270 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-75036ea2-bbf0-470f-97d8-fb43a400e7a3 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:39.236870 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-75036ea2-bbf0-470f-97d8-fb43a400e7a3 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 7631e09a-0908-4af8-960d-bb7ba652ec45] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:39.248051 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-75036ea2-bbf0-470f-97d8-fb43a400e7a3 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:39.249061 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-75036ea2-bbf0-470f-97d8-fb43a400e7a3 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:39.250340 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-75036ea2-bbf0-470f-97d8-fb43a400e7a3 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:39.250959 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-75036ea2-bbf0-470f-97d8-fb43a400e7a3 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:39.253567 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-75036ea2-bbf0-470f-97d8-fb43a400e7a3 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:39.254255 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-75036ea2-bbf0-470f-97d8-fb43a400e7a3 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:39.351397 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-44dcd5fc-2797-4670-b8c8-fb9ca73c3c16 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:39.360109 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-75036ea2-bbf0-470f-97d8-fb43a400e7a3 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 7631e09a-0908-4af8-960d-bb7ba652ec45] Going to try to terminate instance {{(pid=120623) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 19:14:39.381170 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-44dcd5fc-2797-4670-b8c8-fb9ca73c3c16 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48" status: 200 len: 1521 microversion: 2.1 time: 0.260335 Aug 31 19:14:39.382055 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 167/323] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:39 2022] GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:39.466869 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-dc1ad200-c19a-4739-a9f8-bf30c6e337e7 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:39.467821 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-dc1ad200-c19a-4739-a9f8-bf30c6e337e7 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:39.480569 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dc1ad200-c19a-4739-a9f8-bf30c6e337e7 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:39.482699 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dc1ad200-c19a-4739-a9f8-bf30c6e337e7 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:39.483306 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dc1ad200-c19a-4739-a9f8-bf30c6e337e7 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:39.485374 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dc1ad200-c19a-4739-a9f8-bf30c6e337e7 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:39.487025 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dc1ad200-c19a-4739-a9f8-bf30c6e337e7 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:39.488538 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dc1ad200-c19a-4739-a9f8-bf30c6e337e7 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:39.514808 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-75036ea2-bbf0-470f-97d8-fb43a400e7a3 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "DELETE /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45" status: 204 len: 0 microversion: 2.1 time: 0.284031 Aug 31 19:14:39.515526 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 157/324] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 31 19:14:39 2022] DELETE /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:14:39.533865 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-c6d4229a-a1db-4467-b1e3-0c72b8697574 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:39.535921 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-c6d4229a-a1db-4467-b1e3-0c72b8697574 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 7631e09a-0908-4af8-960d-bb7ba652ec45] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:39.556018 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.wsgi [None req-dc1ad200-c19a-4739-a9f8-bf30c6e337e7 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] HTTP exception thrown: Instance 9141c1ef-36d3-4d8c-bd46-8045891fe3c2 could not be found. Aug 31 19:14:39.557767 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c6d4229a-a1db-4467-b1e3-0c72b8697574 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:39.563232 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c6d4229a-a1db-4467-b1e3-0c72b8697574 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:39.563890 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c6d4229a-a1db-4467-b1e3-0c72b8697574 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:39.564788 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c6d4229a-a1db-4467-b1e3-0c72b8697574 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:39.565426 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c6d4229a-a1db-4467-b1e3-0c72b8697574 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:39.567580 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c6d4229a-a1db-4467-b1e3-0c72b8697574 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:39.570135 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-dc1ad200-c19a-4739-a9f8-bf30c6e337e7 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Request method failure captured: Aug 31 19:14:39.570135 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: request: GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 HTTP/1.1 Aug 31 19:14:39.570135 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept: application/json Aug 31 19:14:39.570135 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Aug 31 19:14:39.570135 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Connection: close Aug 31 19:14:39.570135 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Length: 0 Aug 31 19:14:39.570135 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Type: application/json Aug 31 19:14:39.570135 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Host: 10.222.0.65 Aug 31 19:14:39.570135 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Aug 31 19:14:39.570135 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Aug 31 19:14:39.570135 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjD7KTm-F4zCpMk8NUibzVzmmQ7FwDJyLW37MnNPnjMsU3N60Js96TJhF3Snl6KagWX4_a3GzOm74MoHQhk3YJnqfaYewJQqlHA_RoGNeeapJ7GAbqw_BTkrfkqB9xd20EDkJgCR6ZEezJLDeaTuuLe5mQa6ZEG2tR-ZBPOmCwUhycjvg Aug 31 19:14:39.570135 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Aug 31 19:14:39.570135 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Aug 31 19:14:39.570135 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Aug 31 19:14:39.570135 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Aug 31 19:14:39.570135 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Aug 31 19:14:39.570135 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Aug 31 19:14:39.570135 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Id: ba8782e8b0af4a2eb7335a0500716b52 Aug 31 19:14:39.570135 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-DeleteServersTestJSON-115654846 Aug 31 19:14:39.570135 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Role: member,reader Aug 31 19:14:39.570135 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Roles: member,reader Aug 31 19:14:39.571835 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ba8782e8b0af4a2eb7335a0500716b52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ba8782e8b0af4a2eb7335a0500716b52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ba8782e8b0af4a2eb7335a0500716b52", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ba8782e8b0af4a2eb7335a0500716b52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:14:39.571835 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-DeleteServersTestJSON-115654846 Aug 31 19:14:39.571835 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Id: ba8782e8b0af4a2eb7335a0500716b52 Aug 31 19:14:39.571835 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-DeleteServersTestJSON-115654846 Aug 31 19:14:39.571835 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User: tempest-DeleteServersTestJSON-115654846-project Aug 31 19:14:39.571835 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Aug 31 19:14:39.571835 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Aug 31 19:14:39.571835 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Id: b4869c70eac84fddb30090585bc1f0de Aug 31 19:14:39.571835 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-DeleteServersTestJSON-115654846-project Aug 31 19:14:39.571835 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: method: > Aug 31 19:14:39.571835 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: exception: Instance 9141c1ef-36d3-4d8c-bd46-8045891fe3c2 could not be found. Aug 31 19:14:39.571835 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: action_args: {'id': '9141c1ef-36d3-4d8c-bd46-8045891fe3c2'} Aug 31 19:14:39.573177 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:14:39.573177 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:14:39.573177 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:14:39.573177 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:14:39.573177 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:14:39.573177 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:14:39.573177 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:14:39.573177 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:14:39.573177 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:14:39.573177 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:14:39.573177 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9141c1ef-36d3-4d8c-bd46-8045891fe3c2 could not be found. Aug 31 19:14:39.573177 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:14:39.573177 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:14:39.573177 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:14:39.573177 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:14:39.573177 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:14:39.573177 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:14:39.573177 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:14:39.573177 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:14:39.573177 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:14:39.574611 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:14:39.574611 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:14:39.574611 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:14:39.574611 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:14:39.574611 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:14:39.574611 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:14:39.574611 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:14:39.574611 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9141c1ef-36d3-4d8c-bd46-8045891fe3c2 could not be found. Aug 31 19:14:39.574611 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:14:39.574611 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:14:39.574611 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:14:39.574611 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:14:39.574611 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:14:39.574611 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:14:39.574611 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:14:39.574611 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:14:39.574611 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9141c1ef-36d3-4d8c-bd46-8045891fe3c2 could not be found. Aug 31 19:14:39.574611 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:14:39.575971 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-dc1ad200-c19a-4739-a9f8-bf30c6e337e7 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Returning 404 to user: Instance 9141c1ef-36d3-4d8c-bd46-8045891fe3c2 could not be found. {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:14:39.575971 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-dc1ad200-c19a-4739-a9f8-bf30c6e337e7 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 404 len: 111 microversion: 2.1 time: 0.112535 Aug 31 19:14:39.575971 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 168/325] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:39 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:14:39.816482 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-c6d4229a-a1db-4467-b1e3-0c72b8697574 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:39.826916 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-3518524b-f7f6-4697-b67c-4594c896ffff tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:39.829832 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-3518524b-f7f6-4697-b67c-4594c896ffff tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:39.837980 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3518524b-f7f6-4697-b67c-4594c896ffff tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:39.839374 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3518524b-f7f6-4697-b67c-4594c896ffff tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:39.839910 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3518524b-f7f6-4697-b67c-4594c896ffff tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:39.840808 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3518524b-f7f6-4697-b67c-4594c896ffff tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:39.841435 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3518524b-f7f6-4697-b67c-4594c896ffff tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:39.842493 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3518524b-f7f6-4697-b67c-4594c896ffff tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:39.852568 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-c6d4229a-a1db-4467-b1e3-0c72b8697574 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45" status: 200 len: 1504 microversion: 2.1 time: 0.329860 Aug 31 19:14:39.857004 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 158/326] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:39 2022] GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45 => generated 1504 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:39.871595 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.wsgi [None req-3518524b-f7f6-4697-b67c-4594c896ffff tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] HTTP exception thrown: Instance 9141c1ef-36d3-4d8c-bd46-8045891fe3c2 could not be found. Aug 31 19:14:39.873608 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-3518524b-f7f6-4697-b67c-4594c896ffff tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Request method failure captured: Aug 31 19:14:39.873608 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: request: GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2/os-volume_attachments HTTP/1.1 Aug 31 19:14:39.873608 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept: application/json Aug 31 19:14:39.873608 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Aug 31 19:14:39.873608 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Connection: close Aug 31 19:14:39.873608 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Length: 0 Aug 31 19:14:39.873608 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Type: application/json Aug 31 19:14:39.873608 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Host: 10.222.0.65 Aug 31 19:14:39.873608 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Aug 31 19:14:39.873608 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Aug 31 19:14:39.873608 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjD7KTm-F4zCpMk8NUibzVzmmQ7FwDJyLW37MnNPnjMsU3N60Js96TJhF3Snl6KagWX4_a3GzOm74MoHQhk3YJnqfaYewJQqlHA_RoGNeeapJ7GAbqw_BTkrfkqB9xd20EDkJgCR6ZEezJLDeaTuuLe5mQa6ZEG2tR-ZBPOmCwUhycjvg Aug 31 19:14:39.873608 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Aug 31 19:14:39.873608 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Aug 31 19:14:39.873608 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Aug 31 19:14:39.873608 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Aug 31 19:14:39.873608 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Aug 31 19:14:39.873608 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Aug 31 19:14:39.873608 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Id: ba8782e8b0af4a2eb7335a0500716b52 Aug 31 19:14:39.873608 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-DeleteServersTestJSON-115654846 Aug 31 19:14:39.873608 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Role: member,reader Aug 31 19:14:39.873608 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Roles: member,reader Aug 31 19:14:39.874924 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ba8782e8b0af4a2eb7335a0500716b52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ba8782e8b0af4a2eb7335a0500716b52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ba8782e8b0af4a2eb7335a0500716b52", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ba8782e8b0af4a2eb7335a0500716b52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:14:39.874924 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-DeleteServersTestJSON-115654846 Aug 31 19:14:39.874924 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Id: ba8782e8b0af4a2eb7335a0500716b52 Aug 31 19:14:39.874924 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-DeleteServersTestJSON-115654846 Aug 31 19:14:39.874924 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User: tempest-DeleteServersTestJSON-115654846-project Aug 31 19:14:39.874924 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Aug 31 19:14:39.874924 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Aug 31 19:14:39.874924 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Id: b4869c70eac84fddb30090585bc1f0de Aug 31 19:14:39.874924 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-DeleteServersTestJSON-115654846-project Aug 31 19:14:39.874924 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: method: > Aug 31 19:14:39.874924 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: exception: Instance 9141c1ef-36d3-4d8c-bd46-8045891fe3c2 could not be found. Aug 31 19:14:39.874924 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: action_args: {'server_id': '9141c1ef-36d3-4d8c-bd46-8045891fe3c2'} Aug 31 19:14:39.875657 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:14:39.875657 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:14:39.875657 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:14:39.875657 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:14:39.875657 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:14:39.875657 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:14:39.875657 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:14:39.875657 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:14:39.875657 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:14:39.875657 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:14:39.875657 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9141c1ef-36d3-4d8c-bd46-8045891fe3c2 could not be found. Aug 31 19:14:39.875657 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:14:39.875657 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:14:39.875657 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:14:39.875657 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:14:39.875657 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:14:39.875657 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:14:39.875657 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:14:39.875657 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:14:39.875657 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:14:39.876944 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:14:39.876944 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 19:14:39.876944 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 19:14:39.876944 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 19:14:39.876944 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 19:14:39.876944 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 31 19:14:39.876944 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 31 19:14:39.876944 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:14:39.876944 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:14:39.876944 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9141c1ef-36d3-4d8c-bd46-8045891fe3c2 could not be found. Aug 31 19:14:39.876944 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:14:39.876944 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:14:39.876944 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:14:39.876944 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:14:39.876944 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:14:39.876944 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:14:39.876944 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:14:39.876944 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:14:39.876944 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9141c1ef-36d3-4d8c-bd46-8045891fe3c2 could not be found. Aug 31 19:14:39.876944 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:14:39.880123 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-3518524b-f7f6-4697-b67c-4594c896ffff tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Returning 404 to user: Instance 9141c1ef-36d3-4d8c-bd46-8045891fe3c2 could not be found. {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:14:39.881313 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-3518524b-f7f6-4697-b67c-4594c896ffff tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.059274 Aug 31 19:14:39.885685 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 169/327] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 31 19:14:39 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2/os-volume_attachments => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 19:14:40.404742 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-532bdb26-2050-4037-8d10-14e379de43a2 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:40.406284 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-532bdb26-2050-4037-8d10-14e379de43a2 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:40.416087 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-532bdb26-2050-4037-8d10-14e379de43a2 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:40.417853 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-532bdb26-2050-4037-8d10-14e379de43a2 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:40.419693 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-532bdb26-2050-4037-8d10-14e379de43a2 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:40.421353 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-532bdb26-2050-4037-8d10-14e379de43a2 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:40.422567 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-532bdb26-2050-4037-8d10-14e379de43a2 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:40.423473 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-532bdb26-2050-4037-8d10-14e379de43a2 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:40.637271 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-532bdb26-2050-4037-8d10-14e379de43a2 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:40.647197 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-532bdb26-2050-4037-8d10-14e379de43a2 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48" status: 200 len: 1521 microversion: 2.1 time: 0.245331 Aug 31 19:14:40.648161 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 159/328] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:40 2022] GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:14:40.876206 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-d67ea76b-4d41-4d40-ad6c-01b1988d1f2b tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:40.877623 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-d67ea76b-4d41-4d40-ad6c-01b1988d1f2b tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 7631e09a-0908-4af8-960d-bb7ba652ec45] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:40.890578 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d67ea76b-4d41-4d40-ad6c-01b1988d1f2b tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:40.891411 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d67ea76b-4d41-4d40-ad6c-01b1988d1f2b tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:40.892145 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d67ea76b-4d41-4d40-ad6c-01b1988d1f2b tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:40.894088 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d67ea76b-4d41-4d40-ad6c-01b1988d1f2b tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:40.895652 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d67ea76b-4d41-4d40-ad6c-01b1988d1f2b tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:40.897120 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d67ea76b-4d41-4d40-ad6c-01b1988d1f2b tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:41.205430 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-22b2b823-761d-4807-9b53-b3de8568f191 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:41.206074 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-22b2b823-761d-4807-9b53-b3de8568f191 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:41.214704 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-22b2b823-761d-4807-9b53-b3de8568f191 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:41.215689 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-22b2b823-761d-4807-9b53-b3de8568f191 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:41.216360 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-22b2b823-761d-4807-9b53-b3de8568f191 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:41.217430 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-22b2b823-761d-4807-9b53-b3de8568f191 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:41.218111 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-22b2b823-761d-4807-9b53-b3de8568f191 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:41.218668 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-22b2b823-761d-4807-9b53-b3de8568f191 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:41.242311 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-d67ea76b-4d41-4d40-ad6c-01b1988d1f2b tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:41.255932 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.wsgi [None req-22b2b823-761d-4807-9b53-b3de8568f191 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] HTTP exception thrown: Instance 9141c1ef-36d3-4d8c-bd46-8045891fe3c2 could not be found. Aug 31 19:14:41.256939 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-d67ea76b-4d41-4d40-ad6c-01b1988d1f2b tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45" status: 200 len: 1504 microversion: 2.1 time: 0.384620 Aug 31 19:14:41.258931 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 170/329] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:40 2022] GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45 => generated 1504 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:41.264907 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-22b2b823-761d-4807-9b53-b3de8568f191 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Request method failure captured: Aug 31 19:14:41.264907 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: request: DELETE /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 HTTP/1.1 Aug 31 19:14:41.264907 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Accept: application/json Aug 31 19:14:41.264907 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Accept-Encoding: identity Aug 31 19:14:41.264907 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Connection: close Aug 31 19:14:41.264907 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Content-Length: 0 Aug 31 19:14:41.264907 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Content-Type: application/json Aug 31 19:14:41.264907 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Host: 10.222.0.65 Aug 31 19:14:41.264907 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Openstack-System-Scope: None Aug 31 19:14:41.264907 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: User-Agent: python-urllib3/1.26.12 Aug 31 19:14:41.264907 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Auth-Token: gAAAAABjD7KTm-F4zCpMk8NUibzVzmmQ7FwDJyLW37MnNPnjMsU3N60Js96TJhF3Snl6KagWX4_a3GzOm74MoHQhk3YJnqfaYewJQqlHA_RoGNeeapJ7GAbqw_BTkrfkqB9xd20EDkJgCR6ZEezJLDeaTuuLe5mQa6ZEG2tR-ZBPOmCwUhycjvg Aug 31 19:14:41.264907 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Domain-Id: None Aug 31 19:14:41.264907 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Domain-Name: None Aug 31 19:14:41.264907 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Identity-Status: Confirmed Aug 31 19:14:41.264907 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Is-Admin-Project: True Aug 31 19:14:41.264907 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Id: default Aug 31 19:14:41.264907 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Name: Default Aug 31 19:14:41.264907 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Id: ba8782e8b0af4a2eb7335a0500716b52 Aug 31 19:14:41.264907 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Name: tempest-DeleteServersTestJSON-115654846 Aug 31 19:14:41.264907 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Role: member,reader Aug 31 19:14:41.264907 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Roles: member,reader Aug 31 19:14:41.266357 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ba8782e8b0af4a2eb7335a0500716b52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ba8782e8b0af4a2eb7335a0500716b52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ba8782e8b0af4a2eb7335a0500716b52", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ba8782e8b0af4a2eb7335a0500716b52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:14:41.266357 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant: tempest-DeleteServersTestJSON-115654846 Aug 31 19:14:41.266357 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant-Id: ba8782e8b0af4a2eb7335a0500716b52 Aug 31 19:14:41.266357 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant-Name: tempest-DeleteServersTestJSON-115654846 Aug 31 19:14:41.266357 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User: tempest-DeleteServersTestJSON-115654846-project Aug 31 19:14:41.266357 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Id: default Aug 31 19:14:41.266357 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Name: Default Aug 31 19:14:41.266357 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Id: b4869c70eac84fddb30090585bc1f0de Aug 31 19:14:41.266357 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Name: tempest-DeleteServersTestJSON-115654846-project Aug 31 19:14:41.266357 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: method: > Aug 31 19:14:41.266357 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: exception: Instance 9141c1ef-36d3-4d8c-bd46-8045891fe3c2 could not be found. Aug 31 19:14:41.266357 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: action_args: {'id': '9141c1ef-36d3-4d8c-bd46-8045891fe3c2'} Aug 31 19:14:41.267089 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:14:41.267089 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:14:41.267089 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:14:41.267089 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:14:41.267089 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:14:41.267089 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:14:41.267089 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:14:41.267089 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:14:41.267089 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:14:41.267089 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:14:41.267089 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9141c1ef-36d3-4d8c-bd46-8045891fe3c2 could not be found. Aug 31 19:14:41.267089 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:14:41.267089 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:14:41.267089 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:14:41.267089 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:14:41.267089 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:14:41.267089 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:14:41.267089 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:14:41.267089 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:14:41.267089 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:14:41.269488 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:14:41.269488 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 19:14:41.269488 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 19:14:41.269488 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 19:14:41.269488 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 19:14:41.269488 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:14:41.269488 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:14:41.269488 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:14:41.269488 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:14:41.269488 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9141c1ef-36d3-4d8c-bd46-8045891fe3c2 could not be found. Aug 31 19:14:41.269488 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:14:41.269488 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:14:41.269488 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:14:41.269488 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:14:41.269488 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:14:41.269488 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:14:41.269488 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:14:41.269488 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:14:41.269488 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9141c1ef-36d3-4d8c-bd46-8045891fe3c2 could not be found. Aug 31 19:14:41.269488 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:14:41.274079 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-22b2b823-761d-4807-9b53-b3de8568f191 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Returning 404 to user: Instance 9141c1ef-36d3-4d8c-bd46-8045891fe3c2 could not be found. {{(pid=120623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:14:41.275266 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-22b2b823-761d-4807-9b53-b3de8568f191 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "DELETE /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 404 len: 111 microversion: 2.1 time: 0.076245 Aug 31 19:14:41.276233 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 160/330] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 31 19:14:41 2022] DELETE /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:14:41.286362 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-f78e5194-cb10-477e-81e9-03bd665abc24 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:41.287017 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-f78e5194-cb10-477e-81e9-03bd665abc24 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] [instance: 9141c1ef-36d3-4d8c-bd46-8045891fe3c2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:41.298697 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f78e5194-cb10-477e-81e9-03bd665abc24 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:41.299343 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f78e5194-cb10-477e-81e9-03bd665abc24 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:41.299902 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f78e5194-cb10-477e-81e9-03bd665abc24 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:41.300856 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f78e5194-cb10-477e-81e9-03bd665abc24 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:41.301425 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f78e5194-cb10-477e-81e9-03bd665abc24 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:41.301852 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f78e5194-cb10-477e-81e9-03bd665abc24 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:41.319004 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.wsgi [None req-f78e5194-cb10-477e-81e9-03bd665abc24 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] HTTP exception thrown: Instance 9141c1ef-36d3-4d8c-bd46-8045891fe3c2 could not be found. Aug 31 19:14:41.330955 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-f78e5194-cb10-477e-81e9-03bd665abc24 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Request method failure captured: Aug 31 19:14:41.330955 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: request: GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 HTTP/1.1 Aug 31 19:14:41.330955 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept: application/json Aug 31 19:14:41.330955 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Aug 31 19:14:41.330955 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Connection: close Aug 31 19:14:41.330955 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Length: 0 Aug 31 19:14:41.330955 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Type: application/json Aug 31 19:14:41.330955 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Host: 10.222.0.65 Aug 31 19:14:41.330955 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Aug 31 19:14:41.330955 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Aug 31 19:14:41.330955 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjD7KTm-F4zCpMk8NUibzVzmmQ7FwDJyLW37MnNPnjMsU3N60Js96TJhF3Snl6KagWX4_a3GzOm74MoHQhk3YJnqfaYewJQqlHA_RoGNeeapJ7GAbqw_BTkrfkqB9xd20EDkJgCR6ZEezJLDeaTuuLe5mQa6ZEG2tR-ZBPOmCwUhycjvg Aug 31 19:14:41.330955 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Aug 31 19:14:41.330955 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Aug 31 19:14:41.330955 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Aug 31 19:14:41.330955 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Aug 31 19:14:41.330955 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Aug 31 19:14:41.330955 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Aug 31 19:14:41.330955 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Id: ba8782e8b0af4a2eb7335a0500716b52 Aug 31 19:14:41.330955 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-DeleteServersTestJSON-115654846 Aug 31 19:14:41.330955 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Role: member,reader Aug 31 19:14:41.330955 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Roles: member,reader Aug 31 19:14:41.332370 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ba8782e8b0af4a2eb7335a0500716b52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ba8782e8b0af4a2eb7335a0500716b52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ba8782e8b0af4a2eb7335a0500716b52", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ba8782e8b0af4a2eb7335a0500716b52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:14:41.332370 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-DeleteServersTestJSON-115654846 Aug 31 19:14:41.332370 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Id: ba8782e8b0af4a2eb7335a0500716b52 Aug 31 19:14:41.332370 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-DeleteServersTestJSON-115654846 Aug 31 19:14:41.332370 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User: tempest-DeleteServersTestJSON-115654846-project Aug 31 19:14:41.332370 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Aug 31 19:14:41.332370 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Aug 31 19:14:41.332370 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Id: b4869c70eac84fddb30090585bc1f0de Aug 31 19:14:41.332370 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-DeleteServersTestJSON-115654846-project Aug 31 19:14:41.332370 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: method: > Aug 31 19:14:41.332370 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: exception: Instance 9141c1ef-36d3-4d8c-bd46-8045891fe3c2 could not be found. Aug 31 19:14:41.332370 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: action_args: {'id': '9141c1ef-36d3-4d8c-bd46-8045891fe3c2'} Aug 31 19:14:41.333145 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:14:41.333145 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:14:41.333145 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:14:41.333145 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:14:41.333145 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:14:41.333145 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:14:41.333145 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:14:41.333145 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:14:41.333145 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:14:41.333145 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:14:41.333145 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9141c1ef-36d3-4d8c-bd46-8045891fe3c2 could not be found. Aug 31 19:14:41.333145 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:14:41.333145 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:14:41.333145 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:14:41.333145 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:14:41.333145 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:14:41.333145 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:14:41.333145 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:14:41.333145 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:14:41.333145 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:14:41.334565 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:14:41.334565 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:14:41.334565 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:14:41.334565 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:14:41.334565 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:14:41.334565 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:14:41.334565 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:14:41.334565 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9141c1ef-36d3-4d8c-bd46-8045891fe3c2 could not be found. Aug 31 19:14:41.334565 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:14:41.334565 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:14:41.334565 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:14:41.334565 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:14:41.334565 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:14:41.334565 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:14:41.334565 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:14:41.334565 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:14:41.334565 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9141c1ef-36d3-4d8c-bd46-8045891fe3c2 could not be found. Aug 31 19:14:41.334565 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:14:41.335835 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-f78e5194-cb10-477e-81e9-03bd665abc24 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] Returning 404 to user: Instance 9141c1ef-36d3-4d8c-bd46-8045891fe3c2 could not be found. {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:14:41.335835 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-f78e5194-cb10-477e-81e9-03bd665abc24 tempest-DeleteServersTestJSON-115654846 tempest-DeleteServersTestJSON-115654846-project] 10.222.0.65 "GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2" status: 404 len: 111 microversion: 2.1 time: 0.041562 Aug 31 19:14:41.335835 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 171/331] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:41 2022] GET /compute/v2.1/servers/9141c1ef-36d3-4d8c-bd46-8045891fe3c2 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:14:41.676373 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-c93909d5-b949-487a-a110-6596916d2963 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:41.679288 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-c93909d5-b949-487a-a110-6596916d2963 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:41.690267 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c93909d5-b949-487a-a110-6596916d2963 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:41.691788 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c93909d5-b949-487a-a110-6596916d2963 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:41.694114 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c93909d5-b949-487a-a110-6596916d2963 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:41.695053 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c93909d5-b949-487a-a110-6596916d2963 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:41.695832 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c93909d5-b949-487a-a110-6596916d2963 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:41.696427 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c93909d5-b949-487a-a110-6596916d2963 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:41.977699 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-c93909d5-b949-487a-a110-6596916d2963 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:41.988542 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-c93909d5-b949-487a-a110-6596916d2963 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48" status: 200 len: 1521 microversion: 2.1 time: 0.322209 Aug 31 19:14:42.003591 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 161/332] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:41 2022] GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 => generated 1521 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:42.281342 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-a34f821d-22fc-4c91-9629-2c0c7b23d8d7 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:42.288299 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-a34f821d-22fc-4c91-9629-2c0c7b23d8d7 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 7631e09a-0908-4af8-960d-bb7ba652ec45] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:42.292557 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell0:SELECT=4 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:14:42.312907 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a34f821d-22fc-4c91-9629-2c0c7b23d8d7 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:42.313470 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a34f821d-22fc-4c91-9629-2c0c7b23d8d7 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:42.313903 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a34f821d-22fc-4c91-9629-2c0c7b23d8d7 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:42.314984 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a34f821d-22fc-4c91-9629-2c0c7b23d8d7 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:42.315439 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a34f821d-22fc-4c91-9629-2c0c7b23d8d7 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:42.315888 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a34f821d-22fc-4c91-9629-2c0c7b23d8d7 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:42.568532 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-a34f821d-22fc-4c91-9629-2c0c7b23d8d7 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:42.573135 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=100 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:14:42.580641 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-a34f821d-22fc-4c91-9629-2c0c7b23d8d7 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45" status: 200 len: 1504 microversion: 2.1 time: 0.304971 Aug 31 19:14:42.599755 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 172/333] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:42 2022] GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45 => generated 1504 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:42.800869 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-8cba6275-f78f-4a3e-82f1-000efb8df630 req-627df5a4-6011-42c0-9f72-65af020ab86e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7631e09a-0908-4af8-960d-bb7ba652ec45", "name": "network-vif-deleted", "tag": "d1d15f84-67e7-4f44-bb8a-4f9b57959e72"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:14:42.811628 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-8cba6275-f78f-4a3e-82f1-000efb8df630 req-627df5a4-6011-42c0-9f72-65af020ab86e service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:42.811723 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-8cba6275-f78f-4a3e-82f1-000efb8df630 req-627df5a4-6011-42c0-9f72-65af020ab86e service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:42.812238 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-8cba6275-f78f-4a3e-82f1-000efb8df630 req-627df5a4-6011-42c0-9f72-65af020ab86e service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:42.826177 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-8cba6275-f78f-4a3e-82f1-000efb8df630 req-627df5a4-6011-42c0-9f72-65af020ab86e service nova] Creating event network-vif-deleted:d1d15f84-67e7-4f44-bb8a-4f9b57959e72 for instance 7631e09a-0908-4af8-960d-bb7ba652ec45 on hv-cinder-83538 Aug 31 19:14:42.832156 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-8cba6275-f78f-4a3e-82f1-000efb8df630 req-627df5a4-6011-42c0-9f72-65af020ab86e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034818 Aug 31 19:14:42.833853 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 162/334] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:14:43.011529 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-c4b97858-3f19-4e15-b053-1f591ffac3b1 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:43.012471 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-c4b97858-3f19-4e15-b053-1f591ffac3b1 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:43.019010 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c4b97858-3f19-4e15-b053-1f591ffac3b1 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:43.019669 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c4b97858-3f19-4e15-b053-1f591ffac3b1 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:43.020203 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c4b97858-3f19-4e15-b053-1f591ffac3b1 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:43.021101 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c4b97858-3f19-4e15-b053-1f591ffac3b1 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:43.021674 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c4b97858-3f19-4e15-b053-1f591ffac3b1 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:43.022189 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c4b97858-3f19-4e15-b053-1f591ffac3b1 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:43.269944 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-c4b97858-3f19-4e15-b053-1f591ffac3b1 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:43.279278 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-c4b97858-3f19-4e15-b053-1f591ffac3b1 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48" status: 200 len: 1521 microversion: 2.1 time: 0.271951 Aug 31 19:14:43.279947 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 173/335] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:43 2022] GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:43.612077 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-dfae01b2-6ec3-47ab-87e9-8e2c5110a240 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:43.613014 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-dfae01b2-6ec3-47ab-87e9-8e2c5110a240 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 7631e09a-0908-4af8-960d-bb7ba652ec45] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:43.621240 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-dfae01b2-6ec3-47ab-87e9-8e2c5110a240 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:43.623512 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-dfae01b2-6ec3-47ab-87e9-8e2c5110a240 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:43.624119 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-dfae01b2-6ec3-47ab-87e9-8e2c5110a240 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:43.625151 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-dfae01b2-6ec3-47ab-87e9-8e2c5110a240 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:43.626098 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-dfae01b2-6ec3-47ab-87e9-8e2c5110a240 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:43.626702 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-dfae01b2-6ec3-47ab-87e9-8e2c5110a240 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:43.700597 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-dfae01b2-6ec3-47ab-87e9-8e2c5110a240 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:43.701158 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-dfae01b2-6ec3-47ab-87e9-8e2c5110a240 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:43.701861 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-dfae01b2-6ec3-47ab-87e9-8e2c5110a240 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:43.703868 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.objects.instance [None req-dfae01b2-6ec3-47ab-87e9-8e2c5110a240 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lazy-loading 'fault' on Instance uuid 7631e09a-0908-4af8-960d-bb7ba652ec45 {{(pid=120623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:14:43.769823 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-dfae01b2-6ec3-47ab-87e9-8e2c5110a240 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:43.778215 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-dfae01b2-6ec3-47ab-87e9-8e2c5110a240 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45" status: 200 len: 1304 microversion: 2.1 time: 0.175078 Aug 31 19:14:43.779392 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 163/336] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:43 2022] GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45 => generated 1304 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:44.306134 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-a7a35dd5-e54c-443b-8160-7c13fce10122 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:44.307300 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-a7a35dd5-e54c-443b-8160-7c13fce10122 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:44.316309 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a7a35dd5-e54c-443b-8160-7c13fce10122 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:44.316818 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a7a35dd5-e54c-443b-8160-7c13fce10122 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:44.317279 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a7a35dd5-e54c-443b-8160-7c13fce10122 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:44.317981 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a7a35dd5-e54c-443b-8160-7c13fce10122 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:44.318433 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a7a35dd5-e54c-443b-8160-7c13fce10122 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:44.318876 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a7a35dd5-e54c-443b-8160-7c13fce10122 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:44.608421 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-a7a35dd5-e54c-443b-8160-7c13fce10122 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:44.617878 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-a7a35dd5-e54c-443b-8160-7c13fce10122 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48" status: 200 len: 1521 microversion: 2.1 time: 0.318957 Aug 31 19:14:44.635525 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 174/337] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:44 2022] GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 => generated 1521 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:44.799940 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-46e69d0b-a1b1-4b7d-b797-a667bcf2f994 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:44.800842 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-46e69d0b-a1b1-4b7d-b797-a667bcf2f994 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 7631e09a-0908-4af8-960d-bb7ba652ec45] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:44.806898 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-46e69d0b-a1b1-4b7d-b797-a667bcf2f994 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:44.807373 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-46e69d0b-a1b1-4b7d-b797-a667bcf2f994 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:44.807797 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-46e69d0b-a1b1-4b7d-b797-a667bcf2f994 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:44.808475 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-46e69d0b-a1b1-4b7d-b797-a667bcf2f994 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:44.808920 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-46e69d0b-a1b1-4b7d-b797-a667bcf2f994 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:44.809388 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-46e69d0b-a1b1-4b7d-b797-a667bcf2f994 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:44.822958 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.wsgi [None req-46e69d0b-a1b1-4b7d-b797-a667bcf2f994 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] HTTP exception thrown: Instance 7631e09a-0908-4af8-960d-bb7ba652ec45 could not be found. Aug 31 19:14:44.825112 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-46e69d0b-a1b1-4b7d-b797-a667bcf2f994 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Request method failure captured: Aug 31 19:14:44.825112 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: request: GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45 HTTP/1.1 Aug 31 19:14:44.825112 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Accept: application/json Aug 31 19:14:44.825112 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Accept-Encoding: identity Aug 31 19:14:44.825112 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Connection: close Aug 31 19:14:44.825112 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Content-Length: 0 Aug 31 19:14:44.825112 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Content-Type: application/json Aug 31 19:14:44.825112 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Host: 10.222.0.65 Aug 31 19:14:44.825112 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Openstack-System-Scope: None Aug 31 19:14:44.825112 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: User-Agent: python-urllib3/1.26.12 Aug 31 19:14:44.825112 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Auth-Token: gAAAAABjD7L0HTeIZFhl6Riar37GVGvguaWDFa4RUXTfOvKGJx-vTnKDOeQHIWpg8dOuaNJp82S8ZvpjTsg06FxV1rAdD24dkhMEceRLojLioEWagu-LZpbue8JyIJEvsiEyN_gYI8xdcrG_24dohm2tATK4j41uq8Hl1jkDDVgHVLvbZr2c5as Aug 31 19:14:44.825112 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Domain-Id: None Aug 31 19:14:44.825112 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Domain-Name: None Aug 31 19:14:44.825112 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Identity-Status: Confirmed Aug 31 19:14:44.825112 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Is-Admin-Project: True Aug 31 19:14:44.825112 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Id: default Aug 31 19:14:44.825112 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Name: Default Aug 31 19:14:44.825112 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Id: 426e58f469324233b3514e866529eafa Aug 31 19:14:44.825112 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Name: tempest-VolumesActionsTest-612244936 Aug 31 19:14:44.825112 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Role: member,reader Aug 31 19:14:44.825112 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Roles: member,reader Aug 31 19:14:44.826609 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/426e58f469324233b3514e866529eafa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/426e58f469324233b3514e866529eafa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_426e58f469324233b3514e866529eafa", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/426e58f469324233b3514e866529eafa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:14:44.826609 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant: tempest-VolumesActionsTest-612244936 Aug 31 19:14:44.826609 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant-Id: 426e58f469324233b3514e866529eafa Aug 31 19:14:44.826609 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant-Name: tempest-VolumesActionsTest-612244936 Aug 31 19:14:44.826609 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User: tempest-VolumesActionsTest-612244936-project Aug 31 19:14:44.826609 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Id: default Aug 31 19:14:44.826609 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Name: Default Aug 31 19:14:44.826609 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Id: e33c120ef02f4f6e8bea53107d90034b Aug 31 19:14:44.826609 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Name: tempest-VolumesActionsTest-612244936-project Aug 31 19:14:44.826609 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: method: > Aug 31 19:14:44.826609 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: exception: Instance 7631e09a-0908-4af8-960d-bb7ba652ec45 could not be found. Aug 31 19:14:44.826609 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: action_args: {'id': '7631e09a-0908-4af8-960d-bb7ba652ec45'} Aug 31 19:14:44.827462 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:14:44.827462 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:14:44.827462 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:14:44.827462 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:14:44.827462 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:14:44.827462 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:14:44.827462 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:14:44.827462 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:14:44.827462 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:14:44.827462 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:14:44.827462 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7631e09a-0908-4af8-960d-bb7ba652ec45 could not be found. Aug 31 19:14:44.827462 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:14:44.827462 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:14:44.827462 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:14:44.827462 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:14:44.827462 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:14:44.827462 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:14:44.827462 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:14:44.827462 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:14:44.827462 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:14:44.828584 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:14:44.828584 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:14:44.828584 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:14:44.828584 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:14:44.828584 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:14:44.828584 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:14:44.828584 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:14:44.828584 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7631e09a-0908-4af8-960d-bb7ba652ec45 could not be found. Aug 31 19:14:44.828584 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:14:44.828584 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:14:44.828584 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:14:44.828584 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:14:44.828584 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:14:44.828584 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:14:44.828584 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:14:44.828584 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:14:44.828584 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7631e09a-0908-4af8-960d-bb7ba652ec45 could not be found. Aug 31 19:14:44.828584 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:14:44.829855 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-46e69d0b-a1b1-4b7d-b797-a667bcf2f994 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Returning 404 to user: Instance 7631e09a-0908-4af8-960d-bb7ba652ec45 could not be found. {{(pid=120623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:14:44.829855 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-46e69d0b-a1b1-4b7d-b797-a667bcf2f994 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45" status: 404 len: 111 microversion: 2.1 time: 0.030539 Aug 31 19:14:44.829855 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 164/338] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:44 2022] GET /compute/v2.1/servers/7631e09a-0908-4af8-960d-bb7ba652ec45 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:14:44.934599 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-7c4366eb-0988-450c-9508-9f009f99c5d9 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-497665851", "imageRef": "f4f2ae76-bacc-4449-881b-f697e1eeec66", "flavorRef": "452", "networks": [{"uuid": "1dacb2b3-715e-4017-bcf1-0c1b62ea3e3f"}]}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:14:45.643192 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e2a80dd9-a162-43b6-9ab5-d54c1541d33b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:45.644048 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-e2a80dd9-a162-43b6-9ab5-d54c1541d33b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:45.657050 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e2a80dd9-a162-43b6-9ab5-d54c1541d33b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:45.658962 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e2a80dd9-a162-43b6-9ab5-d54c1541d33b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:45.659605 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e2a80dd9-a162-43b6-9ab5-d54c1541d33b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:45.660496 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e2a80dd9-a162-43b6-9ab5-d54c1541d33b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:45.662486 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e2a80dd9-a162-43b6-9ab5-d54c1541d33b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:45.662699 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e2a80dd9-a162-43b6-9ab5-d54c1541d33b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:45.903924 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e2a80dd9-a162-43b6-9ab5-d54c1541d33b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:45.912843 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-e2a80dd9-a162-43b6-9ab5-d54c1541d33b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48" status: 200 len: 1521 microversion: 2.1 time: 0.273892 Aug 31 19:14:45.913446 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 165/339] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:45 2022] GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 => generated 1521 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:46.934607 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-cb0499e1-deb8-48bf-9ef0-f938e3678d01 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:46.935307 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-cb0499e1-deb8-48bf-9ef0-f938e3678d01 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:46.941601 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cb0499e1-deb8-48bf-9ef0-f938e3678d01 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:46.942185 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cb0499e1-deb8-48bf-9ef0-f938e3678d01 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:46.942716 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cb0499e1-deb8-48bf-9ef0-f938e3678d01 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:46.943492 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cb0499e1-deb8-48bf-9ef0-f938e3678d01 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:46.943957 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cb0499e1-deb8-48bf-9ef0-f938e3678d01 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:46.944384 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cb0499e1-deb8-48bf-9ef0-f938e3678d01 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:47.090735 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-cb0499e1-deb8-48bf-9ef0-f938e3678d01 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:47.099084 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-cb0499e1-deb8-48bf-9ef0-f938e3678d01 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48" status: 200 len: 1521 microversion: 2.1 time: 0.169119 Aug 31 19:14:47.099744 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 166/340] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:46 2022] GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:14:48.120269 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-2fc9741f-b3c9-4008-b325-79e8524e9e49 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:48.121038 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-2fc9741f-b3c9-4008-b325-79e8524e9e49 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:48.126932 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2fc9741f-b3c9-4008-b325-79e8524e9e49 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:48.127426 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2fc9741f-b3c9-4008-b325-79e8524e9e49 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:48.127855 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2fc9741f-b3c9-4008-b325-79e8524e9e49 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:48.128524 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2fc9741f-b3c9-4008-b325-79e8524e9e49 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:48.128971 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2fc9741f-b3c9-4008-b325-79e8524e9e49 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:48.129435 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2fc9741f-b3c9-4008-b325-79e8524e9e49 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:48.322963 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-2fc9741f-b3c9-4008-b325-79e8524e9e49 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:48.333011 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-2fc9741f-b3c9-4008-b325-79e8524e9e49 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48" status: 200 len: 1521 microversion: 2.1 time: 0.217004 Aug 31 19:14:48.334105 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 167/341] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:48 2022] GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:14:49.356789 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-62b147ea-a750-4120-b6ab-4eed65abb5fc tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:49.357454 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-62b147ea-a750-4120-b6ab-4eed65abb5fc tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:49.363682 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-62b147ea-a750-4120-b6ab-4eed65abb5fc tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:49.364168 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-62b147ea-a750-4120-b6ab-4eed65abb5fc tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:49.364603 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-62b147ea-a750-4120-b6ab-4eed65abb5fc tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:49.365324 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-62b147ea-a750-4120-b6ab-4eed65abb5fc tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:49.366048 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-62b147ea-a750-4120-b6ab-4eed65abb5fc tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:49.366472 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-62b147ea-a750-4120-b6ab-4eed65abb5fc tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:49.517705 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-62b147ea-a750-4120-b6ab-4eed65abb5fc tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:49.527059 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-62b147ea-a750-4120-b6ab-4eed65abb5fc tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48" status: 200 len: 1521 microversion: 2.1 time: 0.174949 Aug 31 19:14:49.528457 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 168/342] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:49 2022] GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:14:49.571687 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-2c55f930-f10a-4a87-ba9a-5559f4262371 tempest-VolumesTestJSON-1840584087 tempest-VolumesTestJSON-1840584087-project] Calling method '.version_select at 0x7fdb8657e820>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:49.622539 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-2c55f930-f10a-4a87-ba9a-5559f4262371 tempest-VolumesTestJSON-1840584087 tempest-VolumesTestJSON-1840584087-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/2267be46-7c37-4b74-93c6-9c74596f7cec" status: 200 len: 351 microversion: 2.1 time: 0.054582 Aug 31 19:14:49.623227 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 169/343] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 31 19:14:49 2022] GET /compute/v2.1/os-volumes/2267be46-7c37-4b74-93c6-9c74596f7cec => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:14:50.550288 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-15c5c318-0e05-4e31-8faf-2518f9f64e49 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:50.551695 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-15c5c318-0e05-4e31-8faf-2518f9f64e49 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:50.559271 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-15c5c318-0e05-4e31-8faf-2518f9f64e49 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:50.559849 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-15c5c318-0e05-4e31-8faf-2518f9f64e49 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:50.560187 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-15c5c318-0e05-4e31-8faf-2518f9f64e49 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:50.560881 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-15c5c318-0e05-4e31-8faf-2518f9f64e49 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:50.561363 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-15c5c318-0e05-4e31-8faf-2518f9f64e49 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:50.561887 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-15c5c318-0e05-4e31-8faf-2518f9f64e49 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:50.712089 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-15c5c318-0e05-4e31-8faf-2518f9f64e49 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:50.720385 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-15c5c318-0e05-4e31-8faf-2518f9f64e49 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48" status: 200 len: 1521 microversion: 2.1 time: 0.174104 Aug 31 19:14:50.721021 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 170/344] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:50 2022] GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:14:51.742433 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-05fb78fa-8d33-4089-b8ff-dd8dfa7e95dd tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:51.743126 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-05fb78fa-8d33-4089-b8ff-dd8dfa7e95dd tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:51.749808 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-05fb78fa-8d33-4089-b8ff-dd8dfa7e95dd tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:51.750296 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-05fb78fa-8d33-4089-b8ff-dd8dfa7e95dd tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:51.750739 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-05fb78fa-8d33-4089-b8ff-dd8dfa7e95dd tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:51.751753 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-05fb78fa-8d33-4089-b8ff-dd8dfa7e95dd tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:51.751891 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-05fb78fa-8d33-4089-b8ff-dd8dfa7e95dd tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:51.752307 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-05fb78fa-8d33-4089-b8ff-dd8dfa7e95dd tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:51.946428 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-05fb78fa-8d33-4089-b8ff-dd8dfa7e95dd tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:51.954645 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-05fb78fa-8d33-4089-b8ff-dd8dfa7e95dd tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48" status: 200 len: 1521 microversion: 2.1 time: 0.216301 Aug 31 19:14:51.955249 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 171/345] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:51 2022] GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:14:52.085780 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-f3d6e88e-b6ee-4aa5-a621-d86c28838272 tempest-VolumesTestJSON-1840584087 tempest-VolumesTestJSON-1840584087-project] Calling method '.version_select at 0x7fdb86578940>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:52.139338 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-f3d6e88e-b6ee-4aa5-a621-d86c28838272 tempest-VolumesTestJSON-1840584087 tempest-VolumesTestJSON-1840584087-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/b16fb93c-cf25-420d-a884-ba612ffb269c" status: 200 len: 350 microversion: 2.1 time: 0.059687 Aug 31 19:14:52.139896 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 172/346] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 31 19:14:52 2022] GET /compute/v2.1/os-volumes/b16fb93c-cf25-420d-a884-ba612ffb269c => generated 350 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:14:52.975576 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d88624f8-f1ca-499f-9f3b-6a0caf5d5c97 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:52.976979 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d88624f8-f1ca-499f-9f3b-6a0caf5d5c97 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:52.983410 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d88624f8-f1ca-499f-9f3b-6a0caf5d5c97 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:52.983966 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d88624f8-f1ca-499f-9f3b-6a0caf5d5c97 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:52.984389 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d88624f8-f1ca-499f-9f3b-6a0caf5d5c97 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:52.985086 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d88624f8-f1ca-499f-9f3b-6a0caf5d5c97 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:52.985561 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d88624f8-f1ca-499f-9f3b-6a0caf5d5c97 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:52.985980 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d88624f8-f1ca-499f-9f3b-6a0caf5d5c97 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:53.335470 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-d88624f8-f1ca-499f-9f3b-6a0caf5d5c97 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:53.342947 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-d88624f8-f1ca-499f-9f3b-6a0caf5d5c97 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48" status: 200 len: 1521 microversion: 2.1 time: 0.371282 Aug 31 19:14:53.343516 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 173/347] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:52 2022] GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 => generated 1521 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:14:53.892410 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.network.neutron [None req-7c4366eb-0988-450c-9508-9f009f99c5d9 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] validate_networks() for [('1dacb2b3-715e-4017-bcf1-0c1b62ea3e3f', None, None, None, None, None)] {{(pid=120624) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:14:54.301864 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-7c4366eb-0988-450c-9508-9f009f99c5d9 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Flavor limits 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:14:54.302281 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-7c4366eb-0988-450c-9508-9f009f99c5d9 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Image limits 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:14:54.302745 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-7c4366eb-0988-450c-9508-9f009f99c5d9 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Flavor pref 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:14:54.303440 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-7c4366eb-0988-450c-9508-9f009f99c5d9 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Image pref 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:14:54.303745 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-7c4366eb-0988-450c-9508-9f009f99c5d9 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:14:54.307689 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=1 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:14:54.315847 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7c4366eb-0988-450c-9508-9f009f99c5d9 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:54.316505 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7c4366eb-0988-450c-9508-9f009f99c5d9 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:54.316927 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7c4366eb-0988-450c-9508-9f009f99c5d9 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:54.317687 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7c4366eb-0988-450c-9508-9f009f99c5d9 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:54.318236 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7c4366eb-0988-450c-9508-9f009f99c5d9 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:54.318677 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7c4366eb-0988-450c-9508-9f009f99c5d9 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:54.343548 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-7c4366eb-0988-450c-9508-9f009f99c5d9 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Getting quotas for project 426e58f469324233b3514e866529eafa. Resources: {'instances', 'cores', 'ram'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:14:54.343548 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-7c4366eb-0988-450c-9508-9f009f99c5d9 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Getting quotas for user e33c120ef02f4f6e8bea53107d90034b and project 426e58f469324233b3514e866529eafa. Resources: {'instances', 'cores', 'ram'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:14:54.354107 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-7c4366eb-0988-450c-9508-9f009f99c5d9 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Going to run 1 instances... {{(pid=120624) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:14:54.356749 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-7c4366eb-0988-450c-9508-9f009f99c5d9 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 0582fb9e-35d5-48a2-852a-ddd8f3497903] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f4f2ae76-bacc-4449-881b-f697e1eeec66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120624) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:14:54.364105 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-9064775a-3835-4773-9d97-6ff41972f921 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:54.364847 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-9064775a-3835-4773-9d97-6ff41972f921 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:54.372549 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9064775a-3835-4773-9d97-6ff41972f921 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:54.372707 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9064775a-3835-4773-9d97-6ff41972f921 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:54.373084 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9064775a-3835-4773-9d97-6ff41972f921 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:54.373925 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9064775a-3835-4773-9d97-6ff41972f921 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:54.374349 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9064775a-3835-4773-9d97-6ff41972f921 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:54.374775 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9064775a-3835-4773-9d97-6ff41972f921 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:54.407994 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-7c4366eb-0988-450c-9508-9f009f99c5d9 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 9.477545 Aug 31 19:14:54.408897 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 175/348] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 31 19:14:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 9479 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 19:14:54.421164 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-858fcbfb-7bc1-424a-9d00-a1ceb822bef3 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:54.422332 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-858fcbfb-7bc1-424a-9d00-a1ceb822bef3 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 0582fb9e-35d5-48a2-852a-ddd8f3497903] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:54.493413 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-858fcbfb-7bc1-424a-9d00-a1ceb822bef3 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:54.502727 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-858fcbfb-7bc1-424a-9d00-a1ceb822bef3 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903" status: 200 len: 1213 microversion: 2.1 time: 0.086835 Aug 31 19:14:54.503346 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 176/349] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:54 2022] GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:14:54.518295 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-9064775a-3835-4773-9d97-6ff41972f921 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:54.525180 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:14:54.527901 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-9064775a-3835-4773-9d97-6ff41972f921 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48" status: 200 len: 1521 microversion: 2.1 time: 0.167899 Aug 31 19:14:54.528462 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 174/350] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:54 2022] GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:14:54.607062 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-1f4e37a0-3f50-47db-9d0e-96d70d0479cc tempest-VolumesTestJSON-1840584087 tempest-VolumesTestJSON-1840584087-project] Calling method '.version_select at 0x7fdb87264c10>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:54.663338 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-1f4e37a0-3f50-47db-9d0e-96d70d0479cc tempest-VolumesTestJSON-1840584087 tempest-VolumesTestJSON-1840584087-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/1e3587d3-6368-48b8-8d0d-8d54577eba32" status: 200 len: 350 microversion: 2.1 time: 0.060419 Aug 31 19:14:54.664131 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 177/351] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 31 19:14:54 2022] GET /compute/v2.1/os-volumes/1e3587d3-6368-48b8-8d0d-8d54577eba32 => generated 350 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:14:54.679942 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-8f0c8071-a814-42ad-90d9-7487e6ee6501 tempest-VolumesTestJSON-1840584087 tempest-VolumesTestJSON-1840584087-project] Calling method '.version_select at 0x7fdb8657e670>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:54.774204 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-8f0c8071-a814-42ad-90d9-7487e6ee6501 tempest-VolumesTestJSON-1840584087 tempest-VolumesTestJSON-1840584087-project] 10.222.0.65 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.099299 Aug 31 19:14:54.774863 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 175/352] 10.222.0.65 () {58 vars in 1134 bytes} [Wed Aug 31 19:14:54 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:54.788720 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-03e50d65-57c5-4600-9f53-5355632d5242 tempest-VolumesTestJSON-1840584087 tempest-VolumesTestJSON-1840584087-project] Calling method '.version_select at 0x7fdb867b4d30>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:54.876923 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-03e50d65-57c5-4600-9f53-5355632d5242 tempest-VolumesTestJSON-1840584087 tempest-VolumesTestJSON-1840584087-project] 10.222.0.65 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.092345 Aug 31 19:14:54.877512 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 178/353] 10.222.0.65 () {58 vars in 1149 bytes} [Wed Aug 31 19:14:54 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:14:54.891204 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-f565f7b6-bd7c-49ea-83e1-35a85e49eb8a tempest-VolumesTestJSON-1840584087 tempest-VolumesTestJSON-1840584087-project] Calling method '.version_select at 0x7fdb868613a0>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:54.976804 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-f565f7b6-bd7c-49ea-83e1-35a85e49eb8a tempest-VolumesTestJSON-1840584087 tempest-VolumesTestJSON-1840584087-project] 10.222.0.65 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.089558 Aug 31 19:14:54.977462 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 176/354] 10.222.0.65 () {58 vars in 1134 bytes} [Wed Aug 31 19:14:54 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:54.991037 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-81701db6-3c03-4bb9-87fb-5e30aae08fcf tempest-VolumesTestJSON-1840584087 tempest-VolumesTestJSON-1840584087-project] Calling method '.version_select at 0x7fdb86528160>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:55.083062 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-81701db6-3c03-4bb9-87fb-5e30aae08fcf tempest-VolumesTestJSON-1840584087 tempest-VolumesTestJSON-1840584087-project] 10.222.0.65 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.095696 Aug 31 19:14:55.083800 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 179/355] 10.222.0.65 () {58 vars in 1167 bytes} [Wed Aug 31 19:14:54 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:14:55.098195 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-04734005-c18e-41dd-a84f-7b4823e874a5 tempest-VolumesTestJSON-1840584087 tempest-VolumesTestJSON-1840584087-project] Calling method '.version_select at 0x7fdb8658cca0>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:55.207190 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-04734005-c18e-41dd-a84f-7b4823e874a5 tempest-VolumesTestJSON-1840584087 tempest-VolumesTestJSON-1840584087-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.113059 Aug 31 19:14:55.207872 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 177/356] 10.222.0.65 () {58 vars in 1170 bytes} [Wed Aug 31 19:14:55 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:14:55.221455 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-bd2102bb-82ba-4aee-9d57-941be2086774 tempest-VolumesTestJSON-1840584087 tempest-VolumesTestJSON-1840584087-project] Calling method '.version_select at 0x7fdb86528430>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:55.320824 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-bd2102bb-82ba-4aee-9d57-941be2086774 tempest-VolumesTestJSON-1840584087 tempest-VolumesTestJSON-1840584087-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.102967 Aug 31 19:14:55.321421 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 180/357] 10.222.0.65 () {58 vars in 1155 bytes} [Wed Aug 31 19:14:55 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:55.334637 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-51f70cc3-b5be-40df-a555-16d8e765227b tempest-VolumesTestJSON-1840584087 tempest-VolumesTestJSON-1840584087-project] Calling method '.version_select at 0x7fdb8657e4c0>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:55.375627 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-1f897dfc-6b19-48e1-b8d6-0f6cd44a1d22 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-680141077", "imageRef": "f4f2ae76-bacc-4449-881b-f697e1eeec66", "flavorRef": "452"}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:14:55.429981 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-51f70cc3-b5be-40df-a555-16d8e765227b tempest-VolumesTestJSON-1840584087 tempest-VolumesTestJSON-1840584087-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.099232 Aug 31 19:14:55.430542 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 178/358] 10.222.0.65 () {58 vars in 1188 bytes} [Wed Aug 31 19:14:55 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:14:55.443297 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-51da9e80-f0b7-49c7-96de-9105124e693a tempest-VolumesTestJSON-1840584087 tempest-VolumesTestJSON-1840584087-project] Calling method '.version_select at 0x7fdb866715e0>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:55.528011 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-51da9e80-f0b7-49c7-96de-9105124e693a tempest-VolumesTestJSON-1840584087 tempest-VolumesTestJSON-1840584087-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.088454 Aug 31 19:14:55.528571 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 179/359] 10.222.0.65 () {58 vars in 1155 bytes} [Wed Aug 31 19:14:55 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:14:55.533028 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-ccbd91ed-2bf8-40a3-b2c9-3960bfaff5ad tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:55.533830 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-ccbd91ed-2bf8-40a3-b2c9-3960bfaff5ad tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 0582fb9e-35d5-48a2-852a-ddd8f3497903] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:55.540473 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ccbd91ed-2bf8-40a3-b2c9-3960bfaff5ad tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:55.541002 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ccbd91ed-2bf8-40a3-b2c9-3960bfaff5ad tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:55.541595 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ccbd91ed-2bf8-40a3-b2c9-3960bfaff5ad tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:55.547701 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ccbd91ed-2bf8-40a3-b2c9-3960bfaff5ad tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:55.547701 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ccbd91ed-2bf8-40a3-b2c9-3960bfaff5ad tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:55.547701 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ccbd91ed-2bf8-40a3-b2c9-3960bfaff5ad tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:55.612880 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-ccbd91ed-2bf8-40a3-b2c9-3960bfaff5ad tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:55.621846 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-ccbd91ed-2bf8-40a3-b2c9-3960bfaff5ad tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903" status: 200 len: 1265 microversion: 2.1 time: 0.091876 Aug 31 19:14:55.625891 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 180/360] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:55 2022] GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903 => generated 1265 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:55.630755 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-4eec011b-6bae-4354-b18f-ec629b430af6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:55.631569 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-4eec011b-6bae-4354-b18f-ec629b430af6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:55.640362 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4eec011b-6bae-4354-b18f-ec629b430af6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:55.641456 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4eec011b-6bae-4354-b18f-ec629b430af6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:55.641900 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4eec011b-6bae-4354-b18f-ec629b430af6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:55.642630 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4eec011b-6bae-4354-b18f-ec629b430af6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:55.643085 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4eec011b-6bae-4354-b18f-ec629b430af6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:55.643506 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4eec011b-6bae-4354-b18f-ec629b430af6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:55.784885 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-4eec011b-6bae-4354-b18f-ec629b430af6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:55.793423 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-4eec011b-6bae-4354-b18f-ec629b430af6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48" status: 200 len: 1521 microversion: 2.1 time: 0.169937 Aug 31 19:14:55.794000 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 181/361] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:55 2022] GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:56.645602 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-c8f632f8-9a2b-4673-bdbd-dfe0fb8f15e3 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:56.646429 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-c8f632f8-9a2b-4673-bdbd-dfe0fb8f15e3 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 0582fb9e-35d5-48a2-852a-ddd8f3497903] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:56.652802 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c8f632f8-9a2b-4673-bdbd-dfe0fb8f15e3 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:56.653317 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c8f632f8-9a2b-4673-bdbd-dfe0fb8f15e3 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:56.653745 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c8f632f8-9a2b-4673-bdbd-dfe0fb8f15e3 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:56.654436 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c8f632f8-9a2b-4673-bdbd-dfe0fb8f15e3 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:56.654879 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c8f632f8-9a2b-4673-bdbd-dfe0fb8f15e3 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:56.655320 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c8f632f8-9a2b-4673-bdbd-dfe0fb8f15e3 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:56.827036 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-c8f632f8-9a2b-4673-bdbd-dfe0fb8f15e3 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:56.838292 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-c8f632f8-9a2b-4673-bdbd-dfe0fb8f15e3 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903" status: 200 len: 1313 microversion: 2.1 time: 0.196059 Aug 31 19:14:56.838867 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 182/362] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:56 2022] GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903 => generated 1313 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:14:56.843393 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-4b7199e8-3b65-4d20-97ac-5751059010f3 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:56.844291 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-4b7199e8-3b65-4d20-97ac-5751059010f3 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:56.850135 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4b7199e8-3b65-4d20-97ac-5751059010f3 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:56.850622 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4b7199e8-3b65-4d20-97ac-5751059010f3 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:56.851056 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4b7199e8-3b65-4d20-97ac-5751059010f3 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:56.851747 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4b7199e8-3b65-4d20-97ac-5751059010f3 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:56.852196 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4b7199e8-3b65-4d20-97ac-5751059010f3 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:56.852615 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4b7199e8-3b65-4d20-97ac-5751059010f3 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:56.986676 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-4b7199e8-3b65-4d20-97ac-5751059010f3 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:56.995425 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-4b7199e8-3b65-4d20-97ac-5751059010f3 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48" status: 200 len: 1521 microversion: 2.1 time: 0.155545 Aug 31 19:14:56.996140 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 183/363] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:56 2022] GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:57.185283 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-8615932c-713e-4e33-a2cb-052e8c8e02f3 req-c53c110b-290b-40b5-9409-126fd3a1f588 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0582fb9e-35d5-48a2-852a-ddd8f3497903", "tag": "c92d1df8-d68d-459e-9b00-fbf7a3ed8436"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:14:57.196279 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-8615932c-713e-4e33-a2cb-052e8c8e02f3 req-c53c110b-290b-40b5-9409-126fd3a1f588 service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:57.197618 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-8615932c-713e-4e33-a2cb-052e8c8e02f3 req-c53c110b-290b-40b5-9409-126fd3a1f588 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:57.199137 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-8615932c-713e-4e33-a2cb-052e8c8e02f3 req-c53c110b-290b-40b5-9409-126fd3a1f588 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:57.210818 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-8615932c-713e-4e33-a2cb-052e8c8e02f3 req-c53c110b-290b-40b5-9409-126fd3a1f588 service nova] Creating event network-changed:c92d1df8-d68d-459e-9b00-fbf7a3ed8436 for instance 0582fb9e-35d5-48a2-852a-ddd8f3497903 on hv-cinder-83538 Aug 31 19:14:57.220641 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-8615932c-713e-4e33-a2cb-052e8c8e02f3 req-c53c110b-290b-40b5-9409-126fd3a1f588 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039723 Aug 31 19:14:57.221673 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 184/364] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:14:57.864293 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-149bae8a-6eb9-4db9-9334-496fc2d64591 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:57.865726 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-149bae8a-6eb9-4db9-9334-496fc2d64591 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 0582fb9e-35d5-48a2-852a-ddd8f3497903] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:57.871955 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-149bae8a-6eb9-4db9-9334-496fc2d64591 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:57.872441 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-149bae8a-6eb9-4db9-9334-496fc2d64591 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:57.872868 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-149bae8a-6eb9-4db9-9334-496fc2d64591 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:57.873584 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-149bae8a-6eb9-4db9-9334-496fc2d64591 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:57.874034 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-149bae8a-6eb9-4db9-9334-496fc2d64591 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:57.874458 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-149bae8a-6eb9-4db9-9334-496fc2d64591 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:58.018331 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-149bae8a-6eb9-4db9-9334-496fc2d64591 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:58.026917 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-149bae8a-6eb9-4db9-9334-496fc2d64591 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903" status: 200 len: 1313 microversion: 2.1 time: 0.166764 Aug 31 19:14:58.027492 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 185/365] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:57 2022] GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:58.038697 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-49ea81f4-36f4-4466-a602-36bd69b69427 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:58.038697 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-49ea81f4-36f4-4466-a602-36bd69b69427 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:58.038697 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-49ea81f4-36f4-4466-a602-36bd69b69427 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:58.038951 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-49ea81f4-36f4-4466-a602-36bd69b69427 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:58.039305 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-49ea81f4-36f4-4466-a602-36bd69b69427 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:58.039988 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-49ea81f4-36f4-4466-a602-36bd69b69427 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:58.040572 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-49ea81f4-36f4-4466-a602-36bd69b69427 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:58.040997 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-49ea81f4-36f4-4466-a602-36bd69b69427 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:58.181023 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-49ea81f4-36f4-4466-a602-36bd69b69427 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:58.190343 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-49ea81f4-36f4-4466-a602-36bd69b69427 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48" status: 200 len: 1521 microversion: 2.1 time: 0.161843 Aug 31 19:14:58.190930 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 186/366] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:58 2022] GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:14:59.047467 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-bfd3fe1f-7722-42a3-afeb-a2897ded47e3 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:59.048111 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-bfd3fe1f-7722-42a3-afeb-a2897ded47e3 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 0582fb9e-35d5-48a2-852a-ddd8f3497903] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:59.053952 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bfd3fe1f-7722-42a3-afeb-a2897ded47e3 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:59.054440 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bfd3fe1f-7722-42a3-afeb-a2897ded47e3 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:59.054873 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bfd3fe1f-7722-42a3-afeb-a2897ded47e3 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:59.055559 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bfd3fe1f-7722-42a3-afeb-a2897ded47e3 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:59.056016 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bfd3fe1f-7722-42a3-afeb-a2897ded47e3 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:59.056934 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bfd3fe1f-7722-42a3-afeb-a2897ded47e3 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:59.208395 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-bfd3fe1f-7722-42a3-afeb-a2897ded47e3 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:59.216595 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-bfd3fe1f-7722-42a3-afeb-a2897ded47e3 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903" status: 200 len: 1313 microversion: 2.1 time: 0.172847 Aug 31 19:14:59.217164 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 187/367] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:59 2022] GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:14:59.221713 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-8eb29dca-bdb4-4485-a24f-0ba01ebed560 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:14:59.222307 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-8eb29dca-bdb4-4485-a24f-0ba01ebed560 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:14:59.228747 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8eb29dca-bdb4-4485-a24f-0ba01ebed560 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:59.229249 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8eb29dca-bdb4-4485-a24f-0ba01ebed560 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:59.230294 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8eb29dca-bdb4-4485-a24f-0ba01ebed560 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:59.231440 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8eb29dca-bdb4-4485-a24f-0ba01ebed560 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:14:59.231894 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8eb29dca-bdb4-4485-a24f-0ba01ebed560 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:14:59.232316 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8eb29dca-bdb4-4485-a24f-0ba01ebed560 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:14:59.379978 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-8eb29dca-bdb4-4485-a24f-0ba01ebed560 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:14:59.387700 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-8eb29dca-bdb4-4485-a24f-0ba01ebed560 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48" status: 200 len: 1521 microversion: 2.1 time: 0.169577 Aug 31 19:14:59.388263 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 188/368] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:14:59 2022] GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:00.237669 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-51155053-1156-4231-b886-5ca807a69be3 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:00.238282 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-51155053-1156-4231-b886-5ca807a69be3 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 0582fb9e-35d5-48a2-852a-ddd8f3497903] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:00.245733 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-51155053-1156-4231-b886-5ca807a69be3 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:00.246337 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-51155053-1156-4231-b886-5ca807a69be3 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:00.247018 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-51155053-1156-4231-b886-5ca807a69be3 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:00.247948 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-51155053-1156-4231-b886-5ca807a69be3 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:00.248499 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-51155053-1156-4231-b886-5ca807a69be3 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:00.248926 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-51155053-1156-4231-b886-5ca807a69be3 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:00.393178 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-51155053-1156-4231-b886-5ca807a69be3 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:00.401733 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-51155053-1156-4231-b886-5ca807a69be3 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903" status: 200 len: 1313 microversion: 2.1 time: 0.168174 Aug 31 19:15:00.402315 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 189/369] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:00 2022] GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:15:00.414148 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-6a2db2a4-ef54-4997-8a3c-c980af882129 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:00.415015 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-6a2db2a4-ef54-4997-8a3c-c980af882129 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:00.421113 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6a2db2a4-ef54-4997-8a3c-c980af882129 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:00.421745 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6a2db2a4-ef54-4997-8a3c-c980af882129 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:00.422175 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6a2db2a4-ef54-4997-8a3c-c980af882129 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:00.422856 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6a2db2a4-ef54-4997-8a3c-c980af882129 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:00.427369 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6a2db2a4-ef54-4997-8a3c-c980af882129 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:00.427966 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6a2db2a4-ef54-4997-8a3c-c980af882129 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:00.479896 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.network.neutron [None req-1f897dfc-6b19-48e1-b8d6-0f6cd44a1d22 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] validate_networks() for None {{(pid=120624) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:15:00.592742 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-6a2db2a4-ef54-4997-8a3c-c980af882129 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:00.600671 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-6a2db2a4-ef54-4997-8a3c-c980af882129 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48" status: 200 len: 1521 microversion: 2.1 time: 0.190319 Aug 31 19:15:00.601353 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 190/370] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:00 2022] GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:00.845964 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-1f897dfc-6b19-48e1-b8d6-0f6cd44a1d22 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Flavor limits 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:15:00.846420 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-1f897dfc-6b19-48e1-b8d6-0f6cd44a1d22 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Image limits 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:15:00.847087 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-1f897dfc-6b19-48e1-b8d6-0f6cd44a1d22 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Flavor pref 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:15:00.847493 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-1f897dfc-6b19-48e1-b8d6-0f6cd44a1d22 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Image pref 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:15:00.847909 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-1f897dfc-6b19-48e1-b8d6-0f6cd44a1d22 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:15:00.857532 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1f897dfc-6b19-48e1-b8d6-0f6cd44a1d22 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:00.858012 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1f897dfc-6b19-48e1-b8d6-0f6cd44a1d22 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:00.858434 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1f897dfc-6b19-48e1-b8d6-0f6cd44a1d22 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:00.859144 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1f897dfc-6b19-48e1-b8d6-0f6cd44a1d22 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:00.859590 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1f897dfc-6b19-48e1-b8d6-0f6cd44a1d22 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:00.860002 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1f897dfc-6b19-48e1-b8d6-0f6cd44a1d22 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:00.886201 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-1f897dfc-6b19-48e1-b8d6-0f6cd44a1d22 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Getting quotas for project f5e4dacbe64a48f49f697787961e1200. Resources: {'instances', 'cores', 'ram'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:15:00.890217 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-1f897dfc-6b19-48e1-b8d6-0f6cd44a1d22 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Getting quotas for user 426bb2c78bce40179a0a115651b81a5b and project f5e4dacbe64a48f49f697787961e1200. Resources: {'instances', 'cores', 'ram'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:15:00.904883 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-1f897dfc-6b19-48e1-b8d6-0f6cd44a1d22 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Going to run 1 instances... {{(pid=120624) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:15:00.907147 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-1f897dfc-6b19-48e1-b8d6-0f6cd44a1d22 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] [instance: d7634742-9448-4848-a138-5f3f352eb832] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f4f2ae76-bacc-4449-881b-f697e1eeec66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120624) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:15:00.957272 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-1f897dfc-6b19-48e1-b8d6-0f6cd44a1d22 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.585907 Aug 31 19:15:00.958089 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 181/371] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 31 19:14:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 5588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 19:15:00.969093 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-a325bb9b-7e27-4756-83ef-b74af4f163c9 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:00.970086 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-a325bb9b-7e27-4756-83ef-b74af4f163c9 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] [instance: d7634742-9448-4848-a138-5f3f352eb832] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:01.042934 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-a325bb9b-7e27-4756-83ef-b74af4f163c9 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426bb2c78bce40179a0a115651b81a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e4dacbe64a48f49f697787961e1200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:01.064197 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-a325bb9b-7e27-4756-83ef-b74af4f163c9 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] 10.222.0.65 "GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832" status: 200 len: 1214 microversion: 2.1 time: 0.099309 Aug 31 19:15:01.066161 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 191/372] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:00 2022] GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832 => generated 1214 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:01.423303 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-a91d041f-4d80-4d2d-bcad-40c3a4741f8e tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:01.423925 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-a91d041f-4d80-4d2d-bcad-40c3a4741f8e tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 0582fb9e-35d5-48a2-852a-ddd8f3497903] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:01.434752 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a91d041f-4d80-4d2d-bcad-40c3a4741f8e tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:01.435681 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a91d041f-4d80-4d2d-bcad-40c3a4741f8e tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:01.436587 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a91d041f-4d80-4d2d-bcad-40c3a4741f8e tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:01.437689 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a91d041f-4d80-4d2d-bcad-40c3a4741f8e tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:01.439118 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a91d041f-4d80-4d2d-bcad-40c3a4741f8e tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:01.439713 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a91d041f-4d80-4d2d-bcad-40c3a4741f8e tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:01.591832 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-a91d041f-4d80-4d2d-bcad-40c3a4741f8e tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:01.599979 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-a91d041f-4d80-4d2d-bcad-40c3a4741f8e tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903" status: 200 len: 1313 microversion: 2.1 time: 0.180569 Aug 31 19:15:01.600575 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 182/373] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:01 2022] GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903 => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:01.626977 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-f14be7a7-19e5-46cb-b312-4125c55e437d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:01.627583 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-f14be7a7-19e5-46cb-b312-4125c55e437d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:01.640702 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f14be7a7-19e5-46cb-b312-4125c55e437d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:01.641491 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f14be7a7-19e5-46cb-b312-4125c55e437d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:01.642213 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f14be7a7-19e5-46cb-b312-4125c55e437d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:01.643189 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f14be7a7-19e5-46cb-b312-4125c55e437d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:01.644014 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f14be7a7-19e5-46cb-b312-4125c55e437d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:01.644447 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f14be7a7-19e5-46cb-b312-4125c55e437d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:01.798723 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-f14be7a7-19e5-46cb-b312-4125c55e437d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:01.807395 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-f14be7a7-19e5-46cb-b312-4125c55e437d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48" status: 200 len: 1521 microversion: 2.1 time: 0.189507 Aug 31 19:15:01.807956 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 192/374] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:01 2022] GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:02.086351 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-4c6a7990-8275-420b-b92d-ce288aab741b tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:02.087029 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-4c6a7990-8275-420b-b92d-ce288aab741b tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] [instance: d7634742-9448-4848-a138-5f3f352eb832] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:02.095600 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4c6a7990-8275-420b-b92d-ce288aab741b tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:02.096259 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4c6a7990-8275-420b-b92d-ce288aab741b tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:02.096943 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4c6a7990-8275-420b-b92d-ce288aab741b tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:02.098379 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4c6a7990-8275-420b-b92d-ce288aab741b tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:02.099218 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4c6a7990-8275-420b-b92d-ce288aab741b tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:02.099652 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4c6a7990-8275-420b-b92d-ce288aab741b tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:02.167130 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-4c6a7990-8275-420b-b92d-ce288aab741b tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426bb2c78bce40179a0a115651b81a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e4dacbe64a48f49f697787961e1200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:02.175324 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-4c6a7990-8275-420b-b92d-ce288aab741b tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] 10.222.0.65 "GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832" status: 200 len: 1266 microversion: 2.1 time: 0.092998 Aug 31 19:15:02.175899 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 183/375] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:02 2022] GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832 => generated 1266 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:02.622417 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-80bd6f2c-a8a7-44b7-bffb-e506524b326c tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:02.623035 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-80bd6f2c-a8a7-44b7-bffb-e506524b326c tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 0582fb9e-35d5-48a2-852a-ddd8f3497903] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:02.629812 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-80bd6f2c-a8a7-44b7-bffb-e506524b326c tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:02.630389 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-80bd6f2c-a8a7-44b7-bffb-e506524b326c tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:02.630845 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-80bd6f2c-a8a7-44b7-bffb-e506524b326c tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:02.631808 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-80bd6f2c-a8a7-44b7-bffb-e506524b326c tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:02.632273 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-80bd6f2c-a8a7-44b7-bffb-e506524b326c tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:02.632890 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-80bd6f2c-a8a7-44b7-bffb-e506524b326c tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:02.832436 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-80bd6f2c-a8a7-44b7-bffb-e506524b326c tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:02.835431 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-356b9511-2e3a-4c1f-aba4-e82220cfcfbb tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:02.836048 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-356b9511-2e3a-4c1f-aba4-e82220cfcfbb tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:02.844741 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-356b9511-2e3a-4c1f-aba4-e82220cfcfbb tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:02.845244 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-356b9511-2e3a-4c1f-aba4-e82220cfcfbb tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:02.845680 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-356b9511-2e3a-4c1f-aba4-e82220cfcfbb tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:02.851039 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-356b9511-2e3a-4c1f-aba4-e82220cfcfbb tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:02.851039 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-356b9511-2e3a-4c1f-aba4-e82220cfcfbb tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:02.851039 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-356b9511-2e3a-4c1f-aba4-e82220cfcfbb tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:02.854574 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-80bd6f2c-a8a7-44b7-bffb-e506524b326c tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903" status: 200 len: 1313 microversion: 2.1 time: 0.236552 Aug 31 19:15:02.855525 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 193/376] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:02 2022] GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903 => generated 1313 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:03.065007 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-356b9511-2e3a-4c1f-aba4-e82220cfcfbb tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:03.073169 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-356b9511-2e3a-4c1f-aba4-e82220cfcfbb tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48" status: 200 len: 1521 microversion: 2.1 time: 0.245755 Aug 31 19:15:03.073875 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 184/377] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:02 2022] GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:03.196452 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-58f3a683-5ab1-44fd-b0d9-ab1e915db468 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:03.197511 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-58f3a683-5ab1-44fd-b0d9-ab1e915db468 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] [instance: d7634742-9448-4848-a138-5f3f352eb832] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:03.203800 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-58f3a683-5ab1-44fd-b0d9-ab1e915db468 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:03.204291 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-58f3a683-5ab1-44fd-b0d9-ab1e915db468 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:03.204720 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-58f3a683-5ab1-44fd-b0d9-ab1e915db468 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:03.205443 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-58f3a683-5ab1-44fd-b0d9-ab1e915db468 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:03.205895 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-58f3a683-5ab1-44fd-b0d9-ab1e915db468 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:03.206315 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-58f3a683-5ab1-44fd-b0d9-ab1e915db468 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:03.273606 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-58f3a683-5ab1-44fd-b0d9-ab1e915db468 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426bb2c78bce40179a0a115651b81a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e4dacbe64a48f49f697787961e1200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:03.281799 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-58f3a683-5ab1-44fd-b0d9-ab1e915db468 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] 10.222.0.65 "GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832" status: 200 len: 1266 microversion: 2.1 time: 0.089334 Aug 31 19:15:03.282366 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 194/378] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:03 2022] GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832 => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:03.883526 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-a4080b57-2fa7-42fe-ac44-856847c103c7 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:03.884476 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-a4080b57-2fa7-42fe-ac44-856847c103c7 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 0582fb9e-35d5-48a2-852a-ddd8f3497903] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:03.890781 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a4080b57-2fa7-42fe-ac44-856847c103c7 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:03.891419 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a4080b57-2fa7-42fe-ac44-856847c103c7 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:03.891851 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a4080b57-2fa7-42fe-ac44-856847c103c7 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:03.892538 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a4080b57-2fa7-42fe-ac44-856847c103c7 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:03.892984 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a4080b57-2fa7-42fe-ac44-856847c103c7 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:03.893428 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a4080b57-2fa7-42fe-ac44-856847c103c7 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:04.029405 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-a4080b57-2fa7-42fe-ac44-856847c103c7 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:04.036992 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-a4080b57-2fa7-42fe-ac44-856847c103c7 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903" status: 200 len: 1313 microversion: 2.1 time: 0.157423 Aug 31 19:15:04.037573 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 185/379] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:03 2022] GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:04.094168 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-4199a18f-fb49-41ca-a4de-5f42ff11427d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:04.094803 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-4199a18f-fb49-41ca-a4de-5f42ff11427d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:04.100748 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4199a18f-fb49-41ca-a4de-5f42ff11427d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:04.101082 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4199a18f-fb49-41ca-a4de-5f42ff11427d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:04.101538 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4199a18f-fb49-41ca-a4de-5f42ff11427d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:04.102213 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4199a18f-fb49-41ca-a4de-5f42ff11427d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:04.103461 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4199a18f-fb49-41ca-a4de-5f42ff11427d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:04.103889 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4199a18f-fb49-41ca-a4de-5f42ff11427d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:04.303494 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-47a29e3e-976f-4f50-8666-2f5be69ef03c tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:04.304478 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-47a29e3e-976f-4f50-8666-2f5be69ef03c tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] [instance: d7634742-9448-4848-a138-5f3f352eb832] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:04.310455 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-47a29e3e-976f-4f50-8666-2f5be69ef03c tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:04.310934 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-47a29e3e-976f-4f50-8666-2f5be69ef03c tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:04.311523 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-47a29e3e-976f-4f50-8666-2f5be69ef03c tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:04.312377 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-47a29e3e-976f-4f50-8666-2f5be69ef03c tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:04.313207 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-47a29e3e-976f-4f50-8666-2f5be69ef03c tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:04.313784 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-47a29e3e-976f-4f50-8666-2f5be69ef03c tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:04.349806 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-4199a18f-fb49-41ca-a4de-5f42ff11427d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:04.360091 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-4199a18f-fb49-41ca-a4de-5f42ff11427d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48" status: 200 len: 1521 microversion: 2.1 time: 0.269361 Aug 31 19:15:04.361427 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 195/380] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:04 2022] GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 => generated 1521 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:15:04.380954 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-47a29e3e-976f-4f50-8666-2f5be69ef03c tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426bb2c78bce40179a0a115651b81a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e4dacbe64a48f49f697787961e1200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:04.389243 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-47a29e3e-976f-4f50-8666-2f5be69ef03c tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] 10.222.0.65 "GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832" status: 200 len: 1266 microversion: 2.1 time: 0.090151 Aug 31 19:15:04.389867 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 186/381] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:04 2022] GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832 => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:15:05.059546 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-4b398aec-81f8-4eb2-a696-ee102e9ebcf6 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:05.060188 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-4b398aec-81f8-4eb2-a696-ee102e9ebcf6 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 0582fb9e-35d5-48a2-852a-ddd8f3497903] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:05.066416 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4b398aec-81f8-4eb2-a696-ee102e9ebcf6 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:05.066902 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4b398aec-81f8-4eb2-a696-ee102e9ebcf6 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:05.067332 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4b398aec-81f8-4eb2-a696-ee102e9ebcf6 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:05.068021 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4b398aec-81f8-4eb2-a696-ee102e9ebcf6 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:05.068473 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4b398aec-81f8-4eb2-a696-ee102e9ebcf6 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:05.068898 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4b398aec-81f8-4eb2-a696-ee102e9ebcf6 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:05.211693 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-4b398aec-81f8-4eb2-a696-ee102e9ebcf6 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:05.222924 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-4b398aec-81f8-4eb2-a696-ee102e9ebcf6 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903" status: 200 len: 1313 microversion: 2.1 time: 0.167908 Aug 31 19:15:05.223495 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 196/382] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:05 2022] GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:05.381536 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-8fa62515-31f7-4958-b5c4-69166ad18235 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:05.382148 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-8fa62515-31f7-4958-b5c4-69166ad18235 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:05.388602 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8fa62515-31f7-4958-b5c4-69166ad18235 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:05.389083 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8fa62515-31f7-4958-b5c4-69166ad18235 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:05.389553 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8fa62515-31f7-4958-b5c4-69166ad18235 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:05.390308 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8fa62515-31f7-4958-b5c4-69166ad18235 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:05.390763 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8fa62515-31f7-4958-b5c4-69166ad18235 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:05.391185 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8fa62515-31f7-4958-b5c4-69166ad18235 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:05.411615 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-cb533784-6e40-46d1-9df4-6353ea4db765 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:05.412461 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-cb533784-6e40-46d1-9df4-6353ea4db765 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] [instance: d7634742-9448-4848-a138-5f3f352eb832] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:05.419316 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cb533784-6e40-46d1-9df4-6353ea4db765 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:05.420209 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cb533784-6e40-46d1-9df4-6353ea4db765 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:05.420742 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cb533784-6e40-46d1-9df4-6353ea4db765 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:05.421701 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cb533784-6e40-46d1-9df4-6353ea4db765 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:05.422150 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cb533784-6e40-46d1-9df4-6353ea4db765 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:05.422571 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cb533784-6e40-46d1-9df4-6353ea4db765 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:05.492726 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-cb533784-6e40-46d1-9df4-6353ea4db765 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426bb2c78bce40179a0a115651b81a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e4dacbe64a48f49f697787961e1200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:05.500497 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-cb533784-6e40-46d1-9df4-6353ea4db765 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] 10.222.0.65 "GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832" status: 200 len: 1266 microversion: 2.1 time: 0.093128 Aug 31 19:15:05.501267 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 197/383] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:05 2022] GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832 => generated 1266 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:15:05.545272 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-8fa62515-31f7-4958-b5c4-69166ad18235 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:05.554196 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-8fa62515-31f7-4958-b5c4-69166ad18235 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48" status: 200 len: 1521 microversion: 2.1 time: 0.176463 Aug 31 19:15:05.554842 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 187/384] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:05 2022] GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:06.245328 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-c817eb25-afc4-442e-a2d8-3a5f58f9a991 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:06.245941 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-c817eb25-afc4-442e-a2d8-3a5f58f9a991 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 0582fb9e-35d5-48a2-852a-ddd8f3497903] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:06.251841 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c817eb25-afc4-442e-a2d8-3a5f58f9a991 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:06.252331 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c817eb25-afc4-442e-a2d8-3a5f58f9a991 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:06.252767 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c817eb25-afc4-442e-a2d8-3a5f58f9a991 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:06.253477 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c817eb25-afc4-442e-a2d8-3a5f58f9a991 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:06.253932 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c817eb25-afc4-442e-a2d8-3a5f58f9a991 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:06.254359 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c817eb25-afc4-442e-a2d8-3a5f58f9a991 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:06.258391 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=100 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:15:06.403103 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-c817eb25-afc4-442e-a2d8-3a5f58f9a991 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:06.411619 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-c817eb25-afc4-442e-a2d8-3a5f58f9a991 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903" status: 200 len: 1313 microversion: 2.1 time: 0.170634 Aug 31 19:15:06.412633 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 198/385] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:06 2022] GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:06.520310 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-eb360c05-6319-40ac-a3cf-e9cbfead6a72 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:06.520918 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-eb360c05-6319-40ac-a3cf-e9cbfead6a72 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] [instance: d7634742-9448-4848-a138-5f3f352eb832] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:06.527284 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-eb360c05-6319-40ac-a3cf-e9cbfead6a72 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:06.527847 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-eb360c05-6319-40ac-a3cf-e9cbfead6a72 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:06.528307 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-eb360c05-6319-40ac-a3cf-e9cbfead6a72 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:06.529029 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-eb360c05-6319-40ac-a3cf-e9cbfead6a72 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:06.529507 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-eb360c05-6319-40ac-a3cf-e9cbfead6a72 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:06.529926 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-eb360c05-6319-40ac-a3cf-e9cbfead6a72 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:06.576415 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-5f4020c7-a7e7-4640-9534-f67e6aa21862 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:06.577062 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-5f4020c7-a7e7-4640-9534-f67e6aa21862 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:06.583354 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5f4020c7-a7e7-4640-9534-f67e6aa21862 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:06.583856 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5f4020c7-a7e7-4640-9534-f67e6aa21862 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:06.584289 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5f4020c7-a7e7-4640-9534-f67e6aa21862 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:06.584996 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5f4020c7-a7e7-4640-9534-f67e6aa21862 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:06.585485 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5f4020c7-a7e7-4640-9534-f67e6aa21862 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:06.585902 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5f4020c7-a7e7-4640-9534-f67e6aa21862 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:06.599846 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-eb360c05-6319-40ac-a3cf-e9cbfead6a72 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426bb2c78bce40179a0a115651b81a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e4dacbe64a48f49f697787961e1200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:06.609584 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-eb360c05-6319-40ac-a3cf-e9cbfead6a72 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] 10.222.0.65 "GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832" status: 200 len: 1266 microversion: 2.1 time: 0.092901 Aug 31 19:15:06.610215 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 188/386] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:06 2022] GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832 => generated 1266 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:06.743732 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-5f4020c7-a7e7-4640-9534-f67e6aa21862 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:06.753429 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-5f4020c7-a7e7-4640-9534-f67e6aa21862 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48" status: 200 len: 1521 microversion: 2.1 time: 0.180750 Aug 31 19:15:06.754310 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 199/387] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:06 2022] GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:15:07.434712 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-7857398c-2b9d-4e96-93f5-056814a83594 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:07.435236 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-7857398c-2b9d-4e96-93f5-056814a83594 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 0582fb9e-35d5-48a2-852a-ddd8f3497903] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:07.441276 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7857398c-2b9d-4e96-93f5-056814a83594 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:07.442245 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7857398c-2b9d-4e96-93f5-056814a83594 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:07.442680 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7857398c-2b9d-4e96-93f5-056814a83594 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:07.443379 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7857398c-2b9d-4e96-93f5-056814a83594 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:07.445378 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7857398c-2b9d-4e96-93f5-056814a83594 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:07.445378 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7857398c-2b9d-4e96-93f5-056814a83594 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:07.580137 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-7857398c-2b9d-4e96-93f5-056814a83594 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:07.587797 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-7857398c-2b9d-4e96-93f5-056814a83594 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903" status: 200 len: 1313 microversion: 2.1 time: 0.157984 Aug 31 19:15:07.588357 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 189/388] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:07 2022] GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:07.641656 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-4d9d6821-76ee-4f91-af8c-6c03b004f31b tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:07.642312 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-4d9d6821-76ee-4f91-af8c-6c03b004f31b tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] [instance: d7634742-9448-4848-a138-5f3f352eb832] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:07.648420 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4d9d6821-76ee-4f91-af8c-6c03b004f31b tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:07.648807 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4d9d6821-76ee-4f91-af8c-6c03b004f31b tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:07.649276 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4d9d6821-76ee-4f91-af8c-6c03b004f31b tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:07.650033 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4d9d6821-76ee-4f91-af8c-6c03b004f31b tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:07.650516 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4d9d6821-76ee-4f91-af8c-6c03b004f31b tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:07.650942 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4d9d6821-76ee-4f91-af8c-6c03b004f31b tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:07.713523 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-4d9d6821-76ee-4f91-af8c-6c03b004f31b tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426bb2c78bce40179a0a115651b81a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e4dacbe64a48f49f697787961e1200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:07.721416 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-4d9d6821-76ee-4f91-af8c-6c03b004f31b tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] 10.222.0.65 "GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832" status: 200 len: 1266 microversion: 2.1 time: 0.084618 Aug 31 19:15:07.722002 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 200/389] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:07 2022] GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832 => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:07.775249 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-0be4f1c2-e3a9-49a2-98ae-cd98ca9245b9 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:07.788135 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-0be4f1c2-e3a9-49a2-98ae-cd98ca9245b9 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:07.788135 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0be4f1c2-e3a9-49a2-98ae-cd98ca9245b9 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:07.788135 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0be4f1c2-e3a9-49a2-98ae-cd98ca9245b9 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:07.788135 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0be4f1c2-e3a9-49a2-98ae-cd98ca9245b9 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:07.788463 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0be4f1c2-e3a9-49a2-98ae-cd98ca9245b9 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:07.788463 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0be4f1c2-e3a9-49a2-98ae-cd98ca9245b9 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:07.788463 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0be4f1c2-e3a9-49a2-98ae-cd98ca9245b9 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:07.922406 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-0be4f1c2-e3a9-49a2-98ae-cd98ca9245b9 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:07.930174 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-0be4f1c2-e3a9-49a2-98ae-cd98ca9245b9 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48" status: 200 len: 1521 microversion: 2.1 time: 0.159471 Aug 31 19:15:07.931515 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 190/390] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:07 2022] GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:08.608699 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-71f2a522-ab5e-46f5-b0ac-f9de19c1aa11 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:08.609423 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-71f2a522-ab5e-46f5-b0ac-f9de19c1aa11 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 0582fb9e-35d5-48a2-852a-ddd8f3497903] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:08.615753 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-71f2a522-ab5e-46f5-b0ac-f9de19c1aa11 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:08.616256 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-71f2a522-ab5e-46f5-b0ac-f9de19c1aa11 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:08.616723 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-71f2a522-ab5e-46f5-b0ac-f9de19c1aa11 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:08.617477 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-71f2a522-ab5e-46f5-b0ac-f9de19c1aa11 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:08.617923 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-71f2a522-ab5e-46f5-b0ac-f9de19c1aa11 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:08.618337 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-71f2a522-ab5e-46f5-b0ac-f9de19c1aa11 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:08.742619 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-45cd9c19-5f30-4b4d-9d50-2d0bb85a5f37 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:08.743221 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-45cd9c19-5f30-4b4d-9d50-2d0bb85a5f37 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] [instance: d7634742-9448-4848-a138-5f3f352eb832] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:08.749628 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-45cd9c19-5f30-4b4d-9d50-2d0bb85a5f37 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:08.750110 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-45cd9c19-5f30-4b4d-9d50-2d0bb85a5f37 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:08.750540 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-45cd9c19-5f30-4b4d-9d50-2d0bb85a5f37 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:08.751224 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-45cd9c19-5f30-4b4d-9d50-2d0bb85a5f37 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:08.751674 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-45cd9c19-5f30-4b4d-9d50-2d0bb85a5f37 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:08.752334 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-45cd9c19-5f30-4b4d-9d50-2d0bb85a5f37 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:08.754556 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-71f2a522-ab5e-46f5-b0ac-f9de19c1aa11 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:08.762955 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-71f2a522-ab5e-46f5-b0ac-f9de19c1aa11 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903" status: 200 len: 1313 microversion: 2.1 time: 0.158310 Aug 31 19:15:08.763516 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 201/391] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:08 2022] GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:08.823090 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-45cd9c19-5f30-4b4d-9d50-2d0bb85a5f37 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426bb2c78bce40179a0a115651b81a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e4dacbe64a48f49f697787961e1200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:08.838862 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-45cd9c19-5f30-4b4d-9d50-2d0bb85a5f37 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] 10.222.0.65 "GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832" status: 200 len: 1266 microversion: 2.1 time: 0.100148 Aug 31 19:15:08.839793 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 191/392] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:08 2022] GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832 => generated 1266 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:15:08.952196 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-c1c5dd92-36b5-4d19-b402-39bc285fc214 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:08.952801 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-c1c5dd92-36b5-4d19-b402-39bc285fc214 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:08.959034 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c1c5dd92-36b5-4d19-b402-39bc285fc214 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:08.959536 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c1c5dd92-36b5-4d19-b402-39bc285fc214 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:08.959975 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c1c5dd92-36b5-4d19-b402-39bc285fc214 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:08.960694 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c1c5dd92-36b5-4d19-b402-39bc285fc214 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:08.961204 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c1c5dd92-36b5-4d19-b402-39bc285fc214 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:08.961904 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c1c5dd92-36b5-4d19-b402-39bc285fc214 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:09.102144 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-c1c5dd92-36b5-4d19-b402-39bc285fc214 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:09.110450 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-c1c5dd92-36b5-4d19-b402-39bc285fc214 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48" status: 200 len: 1521 microversion: 2.1 time: 0.161920 Aug 31 19:15:09.111174 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 202/393] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:08 2022] GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:09.784872 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-5c018b6c-b9ca-46e3-bd87-40506f38691c tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:09.785520 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-5c018b6c-b9ca-46e3-bd87-40506f38691c tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 0582fb9e-35d5-48a2-852a-ddd8f3497903] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:09.791879 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5c018b6c-b9ca-46e3-bd87-40506f38691c tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:09.792365 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5c018b6c-b9ca-46e3-bd87-40506f38691c tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:09.792803 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5c018b6c-b9ca-46e3-bd87-40506f38691c tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:09.793539 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5c018b6c-b9ca-46e3-bd87-40506f38691c tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:09.793999 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5c018b6c-b9ca-46e3-bd87-40506f38691c tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:09.794424 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5c018b6c-b9ca-46e3-bd87-40506f38691c tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:09.859891 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-bc7e995a-0af8-4bbd-b151-c6db737b046a tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:09.861596 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-bc7e995a-0af8-4bbd-b151-c6db737b046a tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] [instance: d7634742-9448-4848-a138-5f3f352eb832] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:09.866476 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:15:09.871005 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bc7e995a-0af8-4bbd-b151-c6db737b046a tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:09.871779 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bc7e995a-0af8-4bbd-b151-c6db737b046a tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:09.872679 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bc7e995a-0af8-4bbd-b151-c6db737b046a tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:09.873858 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bc7e995a-0af8-4bbd-b151-c6db737b046a tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:09.874664 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bc7e995a-0af8-4bbd-b151-c6db737b046a tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:09.875413 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bc7e995a-0af8-4bbd-b151-c6db737b046a tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:09.950113 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-bc7e995a-0af8-4bbd-b151-c6db737b046a tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426bb2c78bce40179a0a115651b81a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e4dacbe64a48f49f697787961e1200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:09.958307 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-bc7e995a-0af8-4bbd-b151-c6db737b046a tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] 10.222.0.65 "GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832" status: 200 len: 1272 microversion: 2.1 time: 0.102450 Aug 31 19:15:09.958925 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 203/394] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:09 2022] GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832 => generated 1272 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:10.002533 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-5c018b6c-b9ca-46e3-bd87-40506f38691c tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:10.011599 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-5c018b6c-b9ca-46e3-bd87-40506f38691c tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903" status: 200 len: 1313 microversion: 2.1 time: 0.230608 Aug 31 19:15:10.012155 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 192/395] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:09 2022] GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903 => generated 1313 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:10.132366 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-346ef6ba-24e0-4153-8488-8ae4b3785ee4 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:10.133087 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-346ef6ba-24e0-4153-8488-8ae4b3785ee4 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:10.139495 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-346ef6ba-24e0-4153-8488-8ae4b3785ee4 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:10.140084 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-346ef6ba-24e0-4153-8488-8ae4b3785ee4 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:10.140549 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-346ef6ba-24e0-4153-8488-8ae4b3785ee4 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:10.141522 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-346ef6ba-24e0-4153-8488-8ae4b3785ee4 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:10.142215 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-346ef6ba-24e0-4153-8488-8ae4b3785ee4 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:10.144446 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-346ef6ba-24e0-4153-8488-8ae4b3785ee4 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:10.291833 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-346ef6ba-24e0-4153-8488-8ae4b3785ee4 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:10.299454 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-346ef6ba-24e0-4153-8488-8ae4b3785ee4 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48" status: 200 len: 1521 microversion: 2.1 time: 0.171174 Aug 31 19:15:10.300140 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 204/396] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:10 2022] GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:10.598302 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-92e1efce-2d76-43b4-b635-bab469a82433 req-424aadf3-c17e-499c-9e65-04fdf55118be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0582fb9e-35d5-48a2-852a-ddd8f3497903", "name": "network-vif-plugged", "status": "completed", "tag": "c92d1df8-d68d-459e-9b00-fbf7a3ed8436"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:15:10.623726 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-92e1efce-2d76-43b4-b635-bab469a82433 req-424aadf3-c17e-499c-9e65-04fdf55118be service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:10.627305 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-92e1efce-2d76-43b4-b635-bab469a82433 req-424aadf3-c17e-499c-9e65-04fdf55118be service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:10.627752 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-92e1efce-2d76-43b4-b635-bab469a82433 req-424aadf3-c17e-499c-9e65-04fdf55118be service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:10.652122 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-92e1efce-2d76-43b4-b635-bab469a82433 req-424aadf3-c17e-499c-9e65-04fdf55118be service nova] Creating event network-vif-plugged:c92d1df8-d68d-459e-9b00-fbf7a3ed8436 for instance 0582fb9e-35d5-48a2-852a-ddd8f3497903 on hv-cinder-83538 Aug 31 19:15:10.658635 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-92e1efce-2d76-43b4-b635-bab469a82433 req-424aadf3-c17e-499c-9e65-04fdf55118be service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072260 Aug 31 19:15:10.659425 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 193/397] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:15:10.979183 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-59d1a7d5-60c1-47b3-ad4e-ce60763962ae tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:10.979808 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-59d1a7d5-60c1-47b3-ad4e-ce60763962ae tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] [instance: d7634742-9448-4848-a138-5f3f352eb832] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:10.985921 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-59d1a7d5-60c1-47b3-ad4e-ce60763962ae tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:10.986395 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-59d1a7d5-60c1-47b3-ad4e-ce60763962ae tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:10.986817 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-59d1a7d5-60c1-47b3-ad4e-ce60763962ae tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:10.987486 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-59d1a7d5-60c1-47b3-ad4e-ce60763962ae tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:10.987930 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-59d1a7d5-60c1-47b3-ad4e-ce60763962ae tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:10.988345 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-59d1a7d5-60c1-47b3-ad4e-ce60763962ae tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:11.032782 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-10a1fb68-1277-4cdc-a5f6-7892a7bdfe6e tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:11.033688 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-10a1fb68-1277-4cdc-a5f6-7892a7bdfe6e tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 0582fb9e-35d5-48a2-852a-ddd8f3497903] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:11.036060 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell0:SELECT=4 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:15:11.036878 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell0:SELECT=14 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:15:11.042716 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-10a1fb68-1277-4cdc-a5f6-7892a7bdfe6e tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:11.043202 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-10a1fb68-1277-4cdc-a5f6-7892a7bdfe6e tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:11.043702 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-10a1fb68-1277-4cdc-a5f6-7892a7bdfe6e tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:11.044404 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-10a1fb68-1277-4cdc-a5f6-7892a7bdfe6e tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:11.044858 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-10a1fb68-1277-4cdc-a5f6-7892a7bdfe6e tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:11.045324 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-10a1fb68-1277-4cdc-a5f6-7892a7bdfe6e tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:11.064231 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell0:SELECT=2 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:15:11.116215 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-59d1a7d5-60c1-47b3-ad4e-ce60763962ae tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426bb2c78bce40179a0a115651b81a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e4dacbe64a48f49f697787961e1200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:11.123879 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-59d1a7d5-60c1-47b3-ad4e-ce60763962ae tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] 10.222.0.65 "GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832" status: 200 len: 1314 microversion: 2.1 time: 0.148477 Aug 31 19:15:11.125164 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 205/398] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:10 2022] GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:11.179785 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-10a1fb68-1277-4cdc-a5f6-7892a7bdfe6e tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:11.188126 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-10a1fb68-1277-4cdc-a5f6-7892a7bdfe6e tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903" status: 200 len: 1313 microversion: 2.1 time: 0.159597 Aug 31 19:15:11.188693 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 194/399] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:11 2022] GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:15:11.320548 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-5adfca78-e646-4a6a-9696-c3cba574f8b0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:11.321152 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-5adfca78-e646-4a6a-9696-c3cba574f8b0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:11.327698 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5adfca78-e646-4a6a-9696-c3cba574f8b0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:11.328183 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5adfca78-e646-4a6a-9696-c3cba574f8b0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:11.328613 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5adfca78-e646-4a6a-9696-c3cba574f8b0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:11.329396 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5adfca78-e646-4a6a-9696-c3cba574f8b0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:11.329850 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5adfca78-e646-4a6a-9696-c3cba574f8b0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:11.330270 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5adfca78-e646-4a6a-9696-c3cba574f8b0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:11.456404 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-5adfca78-e646-4a6a-9696-c3cba574f8b0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:11.463929 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-5adfca78-e646-4a6a-9696-c3cba574f8b0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48" status: 200 len: 1521 microversion: 2.1 time: 0.147197 Aug 31 19:15:11.464483 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 206/400] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:11 2022] GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:12.145018 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-00f8226f-0d13-4f28-b4c1-586ff3593e9f tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:12.145757 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-00f8226f-0d13-4f28-b4c1-586ff3593e9f tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] [instance: d7634742-9448-4848-a138-5f3f352eb832] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:12.152570 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-00f8226f-0d13-4f28-b4c1-586ff3593e9f tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:12.153042 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-00f8226f-0d13-4f28-b4c1-586ff3593e9f tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:12.153491 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-00f8226f-0d13-4f28-b4c1-586ff3593e9f tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:12.154164 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-00f8226f-0d13-4f28-b4c1-586ff3593e9f tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:12.154607 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-00f8226f-0d13-4f28-b4c1-586ff3593e9f tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:12.155018 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-00f8226f-0d13-4f28-b4c1-586ff3593e9f tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:12.208968 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-96d552e3-3e80-454b-99ab-1c337b149b02 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:12.209761 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-96d552e3-3e80-454b-99ab-1c337b149b02 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 0582fb9e-35d5-48a2-852a-ddd8f3497903] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:12.216224 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-96d552e3-3e80-454b-99ab-1c337b149b02 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:12.216771 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-96d552e3-3e80-454b-99ab-1c337b149b02 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:12.217289 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-96d552e3-3e80-454b-99ab-1c337b149b02 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:12.218036 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-96d552e3-3e80-454b-99ab-1c337b149b02 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:12.218546 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-96d552e3-3e80-454b-99ab-1c337b149b02 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:12.219025 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-96d552e3-3e80-454b-99ab-1c337b149b02 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:12.292013 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-00f8226f-0d13-4f28-b4c1-586ff3593e9f tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426bb2c78bce40179a0a115651b81a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e4dacbe64a48f49f697787961e1200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:12.300082 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-00f8226f-0d13-4f28-b4c1-586ff3593e9f tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] 10.222.0.65 "GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832" status: 200 len: 1314 microversion: 2.1 time: 0.158852 Aug 31 19:15:12.301249 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 195/401] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:12 2022] GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:12.369650 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-96d552e3-3e80-454b-99ab-1c337b149b02 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:12.377095 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-96d552e3-3e80-454b-99ab-1c337b149b02 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903" status: 200 len: 1313 microversion: 2.1 time: 0.171898 Aug 31 19:15:12.377675 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 207/402] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:12 2022] GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:15:12.484522 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-6022531b-ef8d-472d-b04c-5f0c667402d8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:12.485087 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-6022531b-ef8d-472d-b04c-5f0c667402d8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:12.490961 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6022531b-ef8d-472d-b04c-5f0c667402d8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:12.491435 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6022531b-ef8d-472d-b04c-5f0c667402d8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:12.491862 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6022531b-ef8d-472d-b04c-5f0c667402d8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:12.492538 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6022531b-ef8d-472d-b04c-5f0c667402d8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:12.493178 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6022531b-ef8d-472d-b04c-5f0c667402d8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:12.493617 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6022531b-ef8d-472d-b04c-5f0c667402d8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:12.511855 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=100 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:15:12.627620 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-6022531b-ef8d-472d-b04c-5f0c667402d8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:12.635966 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-6022531b-ef8d-472d-b04c-5f0c667402d8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48" status: 200 len: 1521 microversion: 2.1 time: 0.155558 Aug 31 19:15:12.636525 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 196/403] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:12 2022] GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:13.273750 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-1126cb00-4aba-4753-bf38-a1ef45a788a4 req-8192a9b2-92e3-4b66-bc6f-507c6f942d38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7634742-9448-4848-a138-5f3f352eb832", "tag": "12658f41-f52a-4a6e-9340-4674382141cf"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:15:13.283333 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-1126cb00-4aba-4753-bf38-a1ef45a788a4 req-8192a9b2-92e3-4b66-bc6f-507c6f942d38 service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:13.283802 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-1126cb00-4aba-4753-bf38-a1ef45a788a4 req-8192a9b2-92e3-4b66-bc6f-507c6f942d38 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:13.284220 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-1126cb00-4aba-4753-bf38-a1ef45a788a4 req-8192a9b2-92e3-4b66-bc6f-507c6f942d38 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:13.295766 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-1126cb00-4aba-4753-bf38-a1ef45a788a4 req-8192a9b2-92e3-4b66-bc6f-507c6f942d38 service nova] Creating event network-changed:12658f41-f52a-4a6e-9340-4674382141cf for instance d7634742-9448-4848-a138-5f3f352eb832 on hv-cinder-83538 Aug 31 19:15:13.300609 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-1126cb00-4aba-4753-bf38-a1ef45a788a4 req-8192a9b2-92e3-4b66-bc6f-507c6f942d38 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030557 Aug 31 19:15:13.301169 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 208/404] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:15:13.323818 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-cdc383ea-dbf6-46a8-82e0-8d99e733ecbb tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:13.324422 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-cdc383ea-dbf6-46a8-82e0-8d99e733ecbb tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] [instance: d7634742-9448-4848-a138-5f3f352eb832] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:13.330879 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cdc383ea-dbf6-46a8-82e0-8d99e733ecbb tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:13.331535 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cdc383ea-dbf6-46a8-82e0-8d99e733ecbb tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:13.331962 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cdc383ea-dbf6-46a8-82e0-8d99e733ecbb tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:13.332814 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cdc383ea-dbf6-46a8-82e0-8d99e733ecbb tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:13.333288 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cdc383ea-dbf6-46a8-82e0-8d99e733ecbb tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:13.333707 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cdc383ea-dbf6-46a8-82e0-8d99e733ecbb tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:13.399146 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-ee8b9073-ec91-4c80-9840-027388d05100 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:13.399830 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-ee8b9073-ec91-4c80-9840-027388d05100 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 0582fb9e-35d5-48a2-852a-ddd8f3497903] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:13.405987 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ee8b9073-ec91-4c80-9840-027388d05100 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:13.406463 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ee8b9073-ec91-4c80-9840-027388d05100 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:13.406888 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ee8b9073-ec91-4c80-9840-027388d05100 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:13.407566 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ee8b9073-ec91-4c80-9840-027388d05100 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:13.408010 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ee8b9073-ec91-4c80-9840-027388d05100 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:13.408423 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ee8b9073-ec91-4c80-9840-027388d05100 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:13.467300 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-cdc383ea-dbf6-46a8-82e0-8d99e733ecbb tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426bb2c78bce40179a0a115651b81a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e4dacbe64a48f49f697787961e1200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:13.474813 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-cdc383ea-dbf6-46a8-82e0-8d99e733ecbb tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] 10.222.0.65 "GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832" status: 200 len: 1314 microversion: 2.1 time: 0.154884 Aug 31 19:15:13.475367 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 197/405] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:13 2022] GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:13.537346 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-ee8b9073-ec91-4c80-9840-027388d05100 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:13.545477 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-ee8b9073-ec91-4c80-9840-027388d05100 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903" status: 200 len: 1313 microversion: 2.1 time: 0.150500 Aug 31 19:15:13.546034 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 209/406] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:13 2022] GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:15:13.657033 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-7d8bb340-be8b-42c0-8965-379920717e15 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:13.657665 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-7d8bb340-be8b-42c0-8965-379920717e15 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:13.663842 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7d8bb340-be8b-42c0-8965-379920717e15 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:13.664326 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7d8bb340-be8b-42c0-8965-379920717e15 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:13.664753 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7d8bb340-be8b-42c0-8965-379920717e15 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:13.667436 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7d8bb340-be8b-42c0-8965-379920717e15 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:13.667436 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7d8bb340-be8b-42c0-8965-379920717e15 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:13.667436 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7d8bb340-be8b-42c0-8965-379920717e15 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:13.797245 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-7d8bb340-be8b-42c0-8965-379920717e15 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:13.804773 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-7d8bb340-be8b-42c0-8965-379920717e15 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48" status: 200 len: 1521 microversion: 2.1 time: 0.152139 Aug 31 19:15:13.805413 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 198/407] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:13 2022] GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:14.495841 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-111eb825-0bcf-46f9-a4d6-c1a4bb2a7820 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:14.496442 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-111eb825-0bcf-46f9-a4d6-c1a4bb2a7820 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] [instance: d7634742-9448-4848-a138-5f3f352eb832] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:14.502323 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-111eb825-0bcf-46f9-a4d6-c1a4bb2a7820 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:14.502804 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-111eb825-0bcf-46f9-a4d6-c1a4bb2a7820 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:14.503229 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-111eb825-0bcf-46f9-a4d6-c1a4bb2a7820 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:14.503906 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-111eb825-0bcf-46f9-a4d6-c1a4bb2a7820 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:14.504350 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-111eb825-0bcf-46f9-a4d6-c1a4bb2a7820 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:14.504763 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-111eb825-0bcf-46f9-a4d6-c1a4bb2a7820 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:14.566156 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-9e07939e-4c6a-4c73-b8f4-67fcc205fa1d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:14.566861 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-9e07939e-4c6a-4c73-b8f4-67fcc205fa1d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 0582fb9e-35d5-48a2-852a-ddd8f3497903] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:14.575856 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9e07939e-4c6a-4c73-b8f4-67fcc205fa1d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:14.575856 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9e07939e-4c6a-4c73-b8f4-67fcc205fa1d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:14.575856 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9e07939e-4c6a-4c73-b8f4-67fcc205fa1d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:14.576415 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9e07939e-4c6a-4c73-b8f4-67fcc205fa1d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:14.576867 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9e07939e-4c6a-4c73-b8f4-67fcc205fa1d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:14.577315 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9e07939e-4c6a-4c73-b8f4-67fcc205fa1d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:14.636965 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-111eb825-0bcf-46f9-a4d6-c1a4bb2a7820 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426bb2c78bce40179a0a115651b81a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e4dacbe64a48f49f697787961e1200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:14.645267 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-111eb825-0bcf-46f9-a4d6-c1a4bb2a7820 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] 10.222.0.65 "GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832" status: 200 len: 1314 microversion: 2.1 time: 0.153275 Aug 31 19:15:14.645843 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 210/408] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:14 2022] GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:14.714198 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-9e07939e-4c6a-4c73-b8f4-67fcc205fa1d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:14.722004 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-9e07939e-4c6a-4c73-b8f4-67fcc205fa1d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903" status: 200 len: 1313 microversion: 2.1 time: 0.159718 Aug 31 19:15:14.722562 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 199/409] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:14 2022] GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:15:14.826273 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d68d478e-d9d0-4e9a-9b82-64ff8969efab tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:14.826864 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d68d478e-d9d0-4e9a-9b82-64ff8969efab tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:14.832834 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d68d478e-d9d0-4e9a-9b82-64ff8969efab tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:14.833338 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d68d478e-d9d0-4e9a-9b82-64ff8969efab tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:14.833764 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d68d478e-d9d0-4e9a-9b82-64ff8969efab tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:14.834440 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d68d478e-d9d0-4e9a-9b82-64ff8969efab tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:14.834883 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d68d478e-d9d0-4e9a-9b82-64ff8969efab tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:14.835293 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d68d478e-d9d0-4e9a-9b82-64ff8969efab tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:14.962846 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-d68d478e-d9d0-4e9a-9b82-64ff8969efab tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:14.970506 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-d68d478e-d9d0-4e9a-9b82-64ff8969efab tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48" status: 200 len: 1521 microversion: 2.1 time: 0.148023 Aug 31 19:15:14.971067 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 211/410] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:14 2022] GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:15:15.666886 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-d69e6f2b-bf17-416b-b690-1a13afad87fd tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:15.667505 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-d69e6f2b-bf17-416b-b690-1a13afad87fd tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] [instance: d7634742-9448-4848-a138-5f3f352eb832] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:15.674127 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d69e6f2b-bf17-416b-b690-1a13afad87fd tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:15.674617 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d69e6f2b-bf17-416b-b690-1a13afad87fd tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:15.675054 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d69e6f2b-bf17-416b-b690-1a13afad87fd tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:15.675796 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d69e6f2b-bf17-416b-b690-1a13afad87fd tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:15.676252 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d69e6f2b-bf17-416b-b690-1a13afad87fd tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:15.676672 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d69e6f2b-bf17-416b-b690-1a13afad87fd tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:15.743457 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-3eef65b0-c6b2-4fdf-a365-7979c856e9fc tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:15.743985 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-3eef65b0-c6b2-4fdf-a365-7979c856e9fc tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 0582fb9e-35d5-48a2-852a-ddd8f3497903] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:15.750344 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3eef65b0-c6b2-4fdf-a365-7979c856e9fc tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:15.750853 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3eef65b0-c6b2-4fdf-a365-7979c856e9fc tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:15.751282 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3eef65b0-c6b2-4fdf-a365-7979c856e9fc tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:15.751965 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3eef65b0-c6b2-4fdf-a365-7979c856e9fc tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:15.752409 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3eef65b0-c6b2-4fdf-a365-7979c856e9fc tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:15.752821 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3eef65b0-c6b2-4fdf-a365-7979c856e9fc tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:15.810236 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-d69e6f2b-bf17-416b-b690-1a13afad87fd tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426bb2c78bce40179a0a115651b81a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e4dacbe64a48f49f697787961e1200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:15.817984 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-d69e6f2b-bf17-416b-b690-1a13afad87fd tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] 10.222.0.65 "GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832" status: 200 len: 1314 microversion: 2.1 time: 0.155628 Aug 31 19:15:15.818578 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 200/411] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:15 2022] GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:15.885020 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-3eef65b0-c6b2-4fdf-a365-7979c856e9fc tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:15.892857 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-3eef65b0-c6b2-4fdf-a365-7979c856e9fc tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903" status: 200 len: 1313 microversion: 2.1 time: 0.153606 Aug 31 19:15:15.893433 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 212/412] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:15 2022] GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:15:15.991765 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-e876a0d0-548d-489b-bcd6-c0f2233b2772 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:15.992390 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-e876a0d0-548d-489b-bcd6-c0f2233b2772 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:15.998424 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e876a0d0-548d-489b-bcd6-c0f2233b2772 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:15.998851 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e876a0d0-548d-489b-bcd6-c0f2233b2772 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:15.999285 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e876a0d0-548d-489b-bcd6-c0f2233b2772 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:15.999984 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e876a0d0-548d-489b-bcd6-c0f2233b2772 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:16.000438 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e876a0d0-548d-489b-bcd6-c0f2233b2772 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:16.000857 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e876a0d0-548d-489b-bcd6-c0f2233b2772 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:16.128344 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-e876a0d0-548d-489b-bcd6-c0f2233b2772 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:16.136640 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-e876a0d0-548d-489b-bcd6-c0f2233b2772 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48" status: 200 len: 1521 microversion: 2.1 time: 0.148723 Aug 31 19:15:16.137206 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 201/413] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:15 2022] GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:16.838931 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-110b1b53-9e73-444c-950e-b1c58a3ec549 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:16.839661 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-110b1b53-9e73-444c-950e-b1c58a3ec549 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] [instance: d7634742-9448-4848-a138-5f3f352eb832] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:16.845617 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-110b1b53-9e73-444c-950e-b1c58a3ec549 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:16.846098 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-110b1b53-9e73-444c-950e-b1c58a3ec549 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:16.846539 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-110b1b53-9e73-444c-950e-b1c58a3ec549 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:16.847220 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-110b1b53-9e73-444c-950e-b1c58a3ec549 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:16.847676 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-110b1b53-9e73-444c-950e-b1c58a3ec549 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:16.848093 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-110b1b53-9e73-444c-950e-b1c58a3ec549 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:16.914295 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-80764503-b63b-4027-bbe9-72433f2d3237 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:16.914894 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-80764503-b63b-4027-bbe9-72433f2d3237 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 0582fb9e-35d5-48a2-852a-ddd8f3497903] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:16.921402 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-80764503-b63b-4027-bbe9-72433f2d3237 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:16.921882 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-80764503-b63b-4027-bbe9-72433f2d3237 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:16.922310 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-80764503-b63b-4027-bbe9-72433f2d3237 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:16.923000 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-80764503-b63b-4027-bbe9-72433f2d3237 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:16.923452 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-80764503-b63b-4027-bbe9-72433f2d3237 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:16.923876 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-80764503-b63b-4027-bbe9-72433f2d3237 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:16.980977 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-110b1b53-9e73-444c-950e-b1c58a3ec549 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426bb2c78bce40179a0a115651b81a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e4dacbe64a48f49f697787961e1200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:16.990101 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-110b1b53-9e73-444c-950e-b1c58a3ec549 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] 10.222.0.65 "GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832" status: 200 len: 1314 microversion: 2.1 time: 0.155567 Aug 31 19:15:16.990749 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 213/414] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:16 2022] GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:17.057937 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-80764503-b63b-4027-bbe9-72433f2d3237 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:17.065484 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-80764503-b63b-4027-bbe9-72433f2d3237 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903" status: 200 len: 1313 microversion: 2.1 time: 0.155322 Aug 31 19:15:17.066047 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 202/415] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:16 2022] GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:15:17.156291 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-2db3c498-4688-4d3b-83d6-ba9664960c6e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:17.156890 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-2db3c498-4688-4d3b-83d6-ba9664960c6e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:17.162798 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2db3c498-4688-4d3b-83d6-ba9664960c6e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:17.163266 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2db3c498-4688-4d3b-83d6-ba9664960c6e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:17.163686 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2db3c498-4688-4d3b-83d6-ba9664960c6e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:17.164361 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2db3c498-4688-4d3b-83d6-ba9664960c6e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:17.164800 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2db3c498-4688-4d3b-83d6-ba9664960c6e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:17.165900 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2db3c498-4688-4d3b-83d6-ba9664960c6e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:17.294520 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-2db3c498-4688-4d3b-83d6-ba9664960c6e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:17.302117 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-2db3c498-4688-4d3b-83d6-ba9664960c6e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48" status: 200 len: 1521 microversion: 2.1 time: 0.149654 Aug 31 19:15:17.302676 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 214/416] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:17 2022] GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:18.010695 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-bea2f96b-7501-4391-8e67-218f33f4c19b tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:18.012730 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-bea2f96b-7501-4391-8e67-218f33f4c19b tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] [instance: d7634742-9448-4848-a138-5f3f352eb832] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:18.018521 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bea2f96b-7501-4391-8e67-218f33f4c19b tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:18.019001 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bea2f96b-7501-4391-8e67-218f33f4c19b tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:18.019429 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bea2f96b-7501-4391-8e67-218f33f4c19b tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:18.020420 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bea2f96b-7501-4391-8e67-218f33f4c19b tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:18.020876 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bea2f96b-7501-4391-8e67-218f33f4c19b tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:18.021333 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bea2f96b-7501-4391-8e67-218f33f4c19b tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:18.086010 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-2df738c4-d9e9-4012-ae32-dea9fcb79f82 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:18.086533 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-2df738c4-d9e9-4012-ae32-dea9fcb79f82 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 0582fb9e-35d5-48a2-852a-ddd8f3497903] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:18.092439 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2df738c4-d9e9-4012-ae32-dea9fcb79f82 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:18.092925 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2df738c4-d9e9-4012-ae32-dea9fcb79f82 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:18.093393 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2df738c4-d9e9-4012-ae32-dea9fcb79f82 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:18.094086 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2df738c4-d9e9-4012-ae32-dea9fcb79f82 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:18.094542 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2df738c4-d9e9-4012-ae32-dea9fcb79f82 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:18.094966 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2df738c4-d9e9-4012-ae32-dea9fcb79f82 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:18.114427 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=100 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:15:18.151131 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-bea2f96b-7501-4391-8e67-218f33f4c19b tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426bb2c78bce40179a0a115651b81a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e4dacbe64a48f49f697787961e1200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:18.158770 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-bea2f96b-7501-4391-8e67-218f33f4c19b tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] 10.222.0.65 "GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832" status: 200 len: 1314 microversion: 2.1 time: 0.151923 Aug 31 19:15:18.159370 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 203/417] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:18 2022] GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:18.228819 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-2df738c4-d9e9-4012-ae32-dea9fcb79f82 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:18.236741 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-2df738c4-d9e9-4012-ae32-dea9fcb79f82 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903" status: 200 len: 1313 microversion: 2.1 time: 0.154640 Aug 31 19:15:18.237332 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 215/418] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:18 2022] GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:15:18.322144 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-1f1cbdb7-893b-4d4f-b290-29b1f624d9a8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:18.322772 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-1f1cbdb7-893b-4d4f-b290-29b1f624d9a8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:18.329090 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1f1cbdb7-893b-4d4f-b290-29b1f624d9a8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:18.329615 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1f1cbdb7-893b-4d4f-b290-29b1f624d9a8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:18.330048 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1f1cbdb7-893b-4d4f-b290-29b1f624d9a8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:18.330732 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1f1cbdb7-893b-4d4f-b290-29b1f624d9a8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:18.331184 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1f1cbdb7-893b-4d4f-b290-29b1f624d9a8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:18.331605 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1f1cbdb7-893b-4d4f-b290-29b1f624d9a8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:18.463671 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-1f1cbdb7-893b-4d4f-b290-29b1f624d9a8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:18.471965 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-1f1cbdb7-893b-4d4f-b290-29b1f624d9a8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48" status: 200 len: 1521 microversion: 2.1 time: 0.153143 Aug 31 19:15:18.472597 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 204/419] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:18 2022] GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:19.179750 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-6504c7e6-131c-4c8d-a051-338293b456a7 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:19.180280 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-6504c7e6-131c-4c8d-a051-338293b456a7 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] [instance: d7634742-9448-4848-a138-5f3f352eb832] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:19.186162 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6504c7e6-131c-4c8d-a051-338293b456a7 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:19.186635 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6504c7e6-131c-4c8d-a051-338293b456a7 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:19.187109 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6504c7e6-131c-4c8d-a051-338293b456a7 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:19.187786 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6504c7e6-131c-4c8d-a051-338293b456a7 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:19.188260 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6504c7e6-131c-4c8d-a051-338293b456a7 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:19.188671 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6504c7e6-131c-4c8d-a051-338293b456a7 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:19.257777 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-7eb2eeda-35fd-4174-9687-7c328df163a8 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:19.258426 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-7eb2eeda-35fd-4174-9687-7c328df163a8 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 0582fb9e-35d5-48a2-852a-ddd8f3497903] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:19.265643 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7eb2eeda-35fd-4174-9687-7c328df163a8 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:19.265996 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7eb2eeda-35fd-4174-9687-7c328df163a8 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:19.266432 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7eb2eeda-35fd-4174-9687-7c328df163a8 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:19.267333 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7eb2eeda-35fd-4174-9687-7c328df163a8 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:19.267792 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7eb2eeda-35fd-4174-9687-7c328df163a8 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:19.268218 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7eb2eeda-35fd-4174-9687-7c328df163a8 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:19.317493 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-6504c7e6-131c-4c8d-a051-338293b456a7 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426bb2c78bce40179a0a115651b81a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e4dacbe64a48f49f697787961e1200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:19.325735 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-6504c7e6-131c-4c8d-a051-338293b456a7 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] 10.222.0.65 "GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832" status: 200 len: 1314 microversion: 2.1 time: 0.149824 Aug 31 19:15:19.326295 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 216/420] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:19 2022] GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:19.399878 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-7eb2eeda-35fd-4174-9687-7c328df163a8 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:19.407959 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-7eb2eeda-35fd-4174-9687-7c328df163a8 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903" status: 200 len: 1313 microversion: 2.1 time: 0.154033 Aug 31 19:15:19.408519 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 205/421] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:19 2022] GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:15:19.491893 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-05fddc55-9d9b-407a-9a9e-05a94f13edf8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:19.492417 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-05fddc55-9d9b-407a-9a9e-05a94f13edf8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:19.498344 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-05fddc55-9d9b-407a-9a9e-05a94f13edf8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:19.498820 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-05fddc55-9d9b-407a-9a9e-05a94f13edf8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:19.499245 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-05fddc55-9d9b-407a-9a9e-05a94f13edf8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:19.499919 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-05fddc55-9d9b-407a-9a9e-05a94f13edf8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:19.500380 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-05fddc55-9d9b-407a-9a9e-05a94f13edf8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:19.500778 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-05fddc55-9d9b-407a-9a9e-05a94f13edf8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:19.626087 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-05fddc55-9d9b-407a-9a9e-05a94f13edf8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:19.636037 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-05fddc55-9d9b-407a-9a9e-05a94f13edf8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48" status: 200 len: 1521 microversion: 2.1 time: 0.147603 Aug 31 19:15:19.636609 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 217/422] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:19 2022] GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:20.347488 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-42ce2e36-c8d4-44fa-85ee-5f776362e83d tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:20.348097 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-42ce2e36-c8d4-44fa-85ee-5f776362e83d tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] [instance: d7634742-9448-4848-a138-5f3f352eb832] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:20.359661 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-42ce2e36-c8d4-44fa-85ee-5f776362e83d tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:20.360141 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-42ce2e36-c8d4-44fa-85ee-5f776362e83d tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:20.360565 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-42ce2e36-c8d4-44fa-85ee-5f776362e83d tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:20.361417 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-42ce2e36-c8d4-44fa-85ee-5f776362e83d tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:20.361898 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-42ce2e36-c8d4-44fa-85ee-5f776362e83d tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:20.362326 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-42ce2e36-c8d4-44fa-85ee-5f776362e83d tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:20.429030 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e560be2a-4012-4b8b-b07e-b4ea1a16cf0a tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:20.429699 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-e560be2a-4012-4b8b-b07e-b4ea1a16cf0a tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 0582fb9e-35d5-48a2-852a-ddd8f3497903] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:20.436556 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e560be2a-4012-4b8b-b07e-b4ea1a16cf0a tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:20.437248 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e560be2a-4012-4b8b-b07e-b4ea1a16cf0a tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:20.437764 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e560be2a-4012-4b8b-b07e-b4ea1a16cf0a tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:20.438470 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e560be2a-4012-4b8b-b07e-b4ea1a16cf0a tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:20.439026 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e560be2a-4012-4b8b-b07e-b4ea1a16cf0a tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:20.439449 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e560be2a-4012-4b8b-b07e-b4ea1a16cf0a tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:20.498954 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-42ce2e36-c8d4-44fa-85ee-5f776362e83d tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426bb2c78bce40179a0a115651b81a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e4dacbe64a48f49f697787961e1200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:20.507042 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-42ce2e36-c8d4-44fa-85ee-5f776362e83d tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] 10.222.0.65 "GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832" status: 200 len: 1314 microversion: 2.1 time: 0.163675 Aug 31 19:15:20.507611 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 206/423] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:20 2022] GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:20.573714 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e560be2a-4012-4b8b-b07e-b4ea1a16cf0a tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:20.581622 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-e560be2a-4012-4b8b-b07e-b4ea1a16cf0a tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903" status: 200 len: 1313 microversion: 2.1 time: 0.156364 Aug 31 19:15:20.582180 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 218/424] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:20 2022] GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:15:20.656997 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-82c7fb24-4a76-4dc8-a264-517043715cb3 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:20.657559 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-82c7fb24-4a76-4dc8-a264-517043715cb3 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:20.663472 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-82c7fb24-4a76-4dc8-a264-517043715cb3 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:20.663956 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-82c7fb24-4a76-4dc8-a264-517043715cb3 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:20.664390 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-82c7fb24-4a76-4dc8-a264-517043715cb3 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:20.665105 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-82c7fb24-4a76-4dc8-a264-517043715cb3 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:20.665585 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-82c7fb24-4a76-4dc8-a264-517043715cb3 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:20.666192 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-82c7fb24-4a76-4dc8-a264-517043715cb3 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:20.806584 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-82c7fb24-4a76-4dc8-a264-517043715cb3 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:20.814281 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-82c7fb24-4a76-4dc8-a264-517043715cb3 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48" status: 200 len: 1521 microversion: 2.1 time: 0.161224 Aug 31 19:15:20.814837 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 207/425] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:20 2022] GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:21.527183 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-3d88b2ef-d2b3-4b1a-87b0-d7c8c14649ef tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:21.527780 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-3d88b2ef-d2b3-4b1a-87b0-d7c8c14649ef tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] [instance: d7634742-9448-4848-a138-5f3f352eb832] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:21.533804 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3d88b2ef-d2b3-4b1a-87b0-d7c8c14649ef tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:21.534275 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3d88b2ef-d2b3-4b1a-87b0-d7c8c14649ef tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:21.534699 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3d88b2ef-d2b3-4b1a-87b0-d7c8c14649ef tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:21.535397 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3d88b2ef-d2b3-4b1a-87b0-d7c8c14649ef tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:21.535841 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3d88b2ef-d2b3-4b1a-87b0-d7c8c14649ef tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:21.536253 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3d88b2ef-d2b3-4b1a-87b0-d7c8c14649ef tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:21.602054 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-e5d67db3-6c70-4aa5-8e3b-0519c8eb01d6 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:21.602663 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-e5d67db3-6c70-4aa5-8e3b-0519c8eb01d6 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 0582fb9e-35d5-48a2-852a-ddd8f3497903] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:21.609385 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e5d67db3-6c70-4aa5-8e3b-0519c8eb01d6 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:21.609873 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e5d67db3-6c70-4aa5-8e3b-0519c8eb01d6 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:21.610309 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e5d67db3-6c70-4aa5-8e3b-0519c8eb01d6 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:21.611005 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e5d67db3-6c70-4aa5-8e3b-0519c8eb01d6 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:21.611744 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e5d67db3-6c70-4aa5-8e3b-0519c8eb01d6 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:21.611873 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e5d67db3-6c70-4aa5-8e3b-0519c8eb01d6 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:21.664317 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-3d88b2ef-d2b3-4b1a-87b0-d7c8c14649ef tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426bb2c78bce40179a0a115651b81a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e4dacbe64a48f49f697787961e1200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:21.672557 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-3d88b2ef-d2b3-4b1a-87b0-d7c8c14649ef tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] 10.222.0.65 "GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832" status: 200 len: 1314 microversion: 2.1 time: 0.149221 Aug 31 19:15:21.673118 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 219/426] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:21 2022] GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:21.745469 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-e5d67db3-6c70-4aa5-8e3b-0519c8eb01d6 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:21.754270 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-e5d67db3-6c70-4aa5-8e3b-0519c8eb01d6 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903" status: 200 len: 1313 microversion: 2.1 time: 0.156040 Aug 31 19:15:21.754840 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 208/427] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:21 2022] GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:15:21.834763 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e7ec1161-c14d-4cf9-86b4-739cc04e8d28 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:21.835366 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-e7ec1161-c14d-4cf9-86b4-739cc04e8d28 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:21.841383 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e7ec1161-c14d-4cf9-86b4-739cc04e8d28 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:21.841860 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e7ec1161-c14d-4cf9-86b4-739cc04e8d28 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:21.842314 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e7ec1161-c14d-4cf9-86b4-739cc04e8d28 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:21.842990 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e7ec1161-c14d-4cf9-86b4-739cc04e8d28 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:21.843440 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e7ec1161-c14d-4cf9-86b4-739cc04e8d28 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:21.843854 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e7ec1161-c14d-4cf9-86b4-739cc04e8d28 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:21.973904 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e7ec1161-c14d-4cf9-86b4-739cc04e8d28 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:21.982295 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-e7ec1161-c14d-4cf9-86b4-739cc04e8d28 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48" status: 200 len: 1521 microversion: 2.1 time: 0.151311 Aug 31 19:15:21.982852 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 220/428] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:21 2022] GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:22.693752 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-acbcf31c-1c4e-416f-a498-ba3f440a877e tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:22.694362 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-acbcf31c-1c4e-416f-a498-ba3f440a877e tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] [instance: d7634742-9448-4848-a138-5f3f352eb832] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:22.701349 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-acbcf31c-1c4e-416f-a498-ba3f440a877e tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:22.701834 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-acbcf31c-1c4e-416f-a498-ba3f440a877e tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:22.702267 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-acbcf31c-1c4e-416f-a498-ba3f440a877e tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:22.702953 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-acbcf31c-1c4e-416f-a498-ba3f440a877e tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:22.703410 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-acbcf31c-1c4e-416f-a498-ba3f440a877e tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:22.703833 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-acbcf31c-1c4e-416f-a498-ba3f440a877e tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:22.776479 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-006b4ec1-64ff-4e29-8259-801f78ece04d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:22.777164 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-006b4ec1-64ff-4e29-8259-801f78ece04d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 0582fb9e-35d5-48a2-852a-ddd8f3497903] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:22.783098 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-006b4ec1-64ff-4e29-8259-801f78ece04d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:22.783577 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-006b4ec1-64ff-4e29-8259-801f78ece04d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:22.784004 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-006b4ec1-64ff-4e29-8259-801f78ece04d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:22.784858 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-006b4ec1-64ff-4e29-8259-801f78ece04d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:22.785121 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-006b4ec1-64ff-4e29-8259-801f78ece04d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:22.785553 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-006b4ec1-64ff-4e29-8259-801f78ece04d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:22.841593 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-acbcf31c-1c4e-416f-a498-ba3f440a877e tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426bb2c78bce40179a0a115651b81a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e4dacbe64a48f49f697787961e1200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:22.849560 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-acbcf31c-1c4e-416f-a498-ba3f440a877e tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] 10.222.0.65 "GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832" status: 200 len: 1314 microversion: 2.1 time: 0.159602 Aug 31 19:15:22.850480 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 209/429] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:22 2022] GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:22.921338 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-006b4ec1-64ff-4e29-8259-801f78ece04d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:22.929037 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-006b4ec1-64ff-4e29-8259-801f78ece04d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903" status: 200 len: 1313 microversion: 2.1 time: 0.157635 Aug 31 19:15:22.929640 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 221/430] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:22 2022] GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:15:23.003327 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-ad882a32-c810-435d-9a2b-0efe18286268 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:23.003931 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-ad882a32-c810-435d-9a2b-0efe18286268 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:23.010466 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ad882a32-c810-435d-9a2b-0efe18286268 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:23.010933 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ad882a32-c810-435d-9a2b-0efe18286268 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:23.011366 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ad882a32-c810-435d-9a2b-0efe18286268 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:23.012050 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ad882a32-c810-435d-9a2b-0efe18286268 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:23.012498 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ad882a32-c810-435d-9a2b-0efe18286268 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:23.012919 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ad882a32-c810-435d-9a2b-0efe18286268 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:23.146087 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-ad882a32-c810-435d-9a2b-0efe18286268 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:23.154143 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-ad882a32-c810-435d-9a2b-0efe18286268 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48" status: 200 len: 1521 microversion: 2.1 time: 0.154567 Aug 31 19:15:23.154704 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 210/431] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:22 2022] GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:23.869814 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-5815be69-ccf9-4510-ae1a-6c7ed95739d1 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:23.870418 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-5815be69-ccf9-4510-ae1a-6c7ed95739d1 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] [instance: d7634742-9448-4848-a138-5f3f352eb832] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:23.876290 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5815be69-ccf9-4510-ae1a-6c7ed95739d1 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:23.876866 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5815be69-ccf9-4510-ae1a-6c7ed95739d1 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:23.877329 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5815be69-ccf9-4510-ae1a-6c7ed95739d1 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:23.878085 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5815be69-ccf9-4510-ae1a-6c7ed95739d1 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:23.878557 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5815be69-ccf9-4510-ae1a-6c7ed95739d1 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:23.879019 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5815be69-ccf9-4510-ae1a-6c7ed95739d1 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:23.949904 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-0bed3278-a43f-4602-8f2e-3b1363b26437 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:23.951135 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-0bed3278-a43f-4602-8f2e-3b1363b26437 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 0582fb9e-35d5-48a2-852a-ddd8f3497903] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:23.957495 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0bed3278-a43f-4602-8f2e-3b1363b26437 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:23.957976 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0bed3278-a43f-4602-8f2e-3b1363b26437 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:23.958402 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0bed3278-a43f-4602-8f2e-3b1363b26437 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:23.959087 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0bed3278-a43f-4602-8f2e-3b1363b26437 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:23.959535 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0bed3278-a43f-4602-8f2e-3b1363b26437 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:23.959951 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0bed3278-a43f-4602-8f2e-3b1363b26437 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:24.010689 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-5815be69-ccf9-4510-ae1a-6c7ed95739d1 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426bb2c78bce40179a0a115651b81a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e4dacbe64a48f49f697787961e1200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:24.018422 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-5815be69-ccf9-4510-ae1a-6c7ed95739d1 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] 10.222.0.65 "GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832" status: 200 len: 1314 microversion: 2.1 time: 0.152340 Aug 31 19:15:24.018985 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 222/432] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:23 2022] GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:24.092611 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-0bed3278-a43f-4602-8f2e-3b1363b26437 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:24.100880 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-0bed3278-a43f-4602-8f2e-3b1363b26437 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903" status: 200 len: 1313 microversion: 2.1 time: 0.155421 Aug 31 19:15:24.101495 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 211/433] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:23 2022] GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:24.174161 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-8883cd9a-e7b8-46e8-ae65-7b8cdda7d2d2 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:24.174777 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-8883cd9a-e7b8-46e8-ae65-7b8cdda7d2d2 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:24.180987 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8883cd9a-e7b8-46e8-ae65-7b8cdda7d2d2 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:24.182438 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8883cd9a-e7b8-46e8-ae65-7b8cdda7d2d2 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:24.182885 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8883cd9a-e7b8-46e8-ae65-7b8cdda7d2d2 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:24.183594 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8883cd9a-e7b8-46e8-ae65-7b8cdda7d2d2 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:24.184046 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8883cd9a-e7b8-46e8-ae65-7b8cdda7d2d2 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:24.184467 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8883cd9a-e7b8-46e8-ae65-7b8cdda7d2d2 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:24.310952 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-8883cd9a-e7b8-46e8-ae65-7b8cdda7d2d2 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:24.318674 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-8883cd9a-e7b8-46e8-ae65-7b8cdda7d2d2 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48" status: 200 len: 1521 microversion: 2.1 time: 0.148293 Aug 31 19:15:24.319233 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 223/434] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:24 2022] GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:25.039490 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-5355f3cc-d887-4c14-972d-eae54e2ebe53 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:25.040100 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-5355f3cc-d887-4c14-972d-eae54e2ebe53 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] [instance: d7634742-9448-4848-a138-5f3f352eb832] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:25.042946 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=6 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:15:25.048255 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5355f3cc-d887-4c14-972d-eae54e2ebe53 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:25.048738 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5355f3cc-d887-4c14-972d-eae54e2ebe53 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:25.049175 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5355f3cc-d887-4c14-972d-eae54e2ebe53 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:25.049887 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5355f3cc-d887-4c14-972d-eae54e2ebe53 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:25.050339 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5355f3cc-d887-4c14-972d-eae54e2ebe53 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:25.050759 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5355f3cc-d887-4c14-972d-eae54e2ebe53 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:25.122274 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-09e7c379-dfbf-4ae2-a9af-c379b57b0020 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:25.122898 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-09e7c379-dfbf-4ae2-a9af-c379b57b0020 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 0582fb9e-35d5-48a2-852a-ddd8f3497903] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:25.129397 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-09e7c379-dfbf-4ae2-a9af-c379b57b0020 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:25.129520 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-09e7c379-dfbf-4ae2-a9af-c379b57b0020 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:25.129892 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-09e7c379-dfbf-4ae2-a9af-c379b57b0020 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:25.130758 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-09e7c379-dfbf-4ae2-a9af-c379b57b0020 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:25.131211 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-09e7c379-dfbf-4ae2-a9af-c379b57b0020 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:25.131631 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-09e7c379-dfbf-4ae2-a9af-c379b57b0020 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:25.181963 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-5355f3cc-d887-4c14-972d-eae54e2ebe53 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426bb2c78bce40179a0a115651b81a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e4dacbe64a48f49f697787961e1200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:25.189702 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-5355f3cc-d887-4c14-972d-eae54e2ebe53 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] 10.222.0.65 "GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832" status: 200 len: 1314 microversion: 2.1 time: 0.154246 Aug 31 19:15:25.190454 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 212/435] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:25 2022] GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:25.265348 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-09e7c379-dfbf-4ae2-a9af-c379b57b0020 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:25.272872 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-09e7c379-dfbf-4ae2-a9af-c379b57b0020 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903" status: 200 len: 1313 microversion: 2.1 time: 0.154450 Aug 31 19:15:25.273458 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 224/436] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:25 2022] GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:15:25.339902 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-758014fe-d42b-40bf-898a-f273c02363ec tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:25.340625 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-758014fe-d42b-40bf-898a-f273c02363ec tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:25.346492 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-758014fe-d42b-40bf-898a-f273c02363ec tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:25.346966 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-758014fe-d42b-40bf-898a-f273c02363ec tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:25.347390 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-758014fe-d42b-40bf-898a-f273c02363ec tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:25.348058 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-758014fe-d42b-40bf-898a-f273c02363ec tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:25.348500 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-758014fe-d42b-40bf-898a-f273c02363ec tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:25.348910 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-758014fe-d42b-40bf-898a-f273c02363ec tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:25.354056 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=100 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:15:25.483756 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-758014fe-d42b-40bf-898a-f273c02363ec tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:25.491255 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-758014fe-d42b-40bf-898a-f273c02363ec tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48" status: 200 len: 1501 microversion: 2.1 time: 0.155641 Aug 31 19:15:25.491823 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 213/437] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:25 2022] GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 => generated 1501 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:25.511419 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-cae6f9fa-d4e2-440b-98c9-c7f4389c9412 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9dd1a7fc-38e4-4c6e-a4f9-6851c21b43e8"}} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:15:25.513840 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-cae6f9fa-d4e2-440b-98c9-c7f4389c9412 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:25.519665 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cae6f9fa-d4e2-440b-98c9-c7f4389c9412 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:25.520137 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cae6f9fa-d4e2-440b-98c9-c7f4389c9412 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:25.520565 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cae6f9fa-d4e2-440b-98c9-c7f4389c9412 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:25.521289 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cae6f9fa-d4e2-440b-98c9-c7f4389c9412 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:25.521740 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cae6f9fa-d4e2-440b-98c9-c7f4389c9412 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:25.522150 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cae6f9fa-d4e2-440b-98c9-c7f4389c9412 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:25.545334 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.wsgi [None req-cae6f9fa-d4e2-440b-98c9-c7f4389c9412 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] HTTP exception thrown: Cannot 'attach_volume' instance 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 while it is in vm_state rescued Aug 31 19:15:25.547220 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-cae6f9fa-d4e2-440b-98c9-c7f4389c9412 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Request method failure captured: Aug 31 19:15:25.547220 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: request: POST /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48/os-volume_attachments HTTP/1.1 Aug 31 19:15:25.547220 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Accept: application/json Aug 31 19:15:25.547220 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Accept-Encoding: identity Aug 31 19:15:25.547220 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Connection: close Aug 31 19:15:25.547220 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Content-Length: 74 Aug 31 19:15:25.547220 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Content-Type: application/json Aug 31 19:15:25.547220 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Host: 10.222.0.65 Aug 31 19:15:25.547220 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Openstack-System-Scope: None Aug 31 19:15:25.547220 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: User-Agent: python-urllib3/1.26.12 Aug 31 19:15:25.547220 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Auth-Token: gAAAAABjD7KOlBALRYg9399MMb60KjA4ASvzgtL1fbEjfGfYKkQDFDd34Xyka_n4-xuhW1XYCsQfE8u_kNDZeL9oEdunAB6QbQoi_8yNGy9km4X1NZ-R1OWPUKtY-9EToi-YGlRmDnKh4j-19QgSeWbL8e8I_blzc8DpEbhUiI4vF3YAGNOsMLo Aug 31 19:15:25.547220 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Domain-Id: None Aug 31 19:15:25.547220 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Domain-Name: None Aug 31 19:15:25.547220 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Identity-Status: Confirmed Aug 31 19:15:25.547220 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Is-Admin-Project: True Aug 31 19:15:25.547220 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Id: default Aug 31 19:15:25.547220 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Name: Default Aug 31 19:15:25.547220 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Id: e3aa913bb25c45039643ce87bb84cbc2 Aug 31 19:15:25.547220 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-30468556 Aug 31 19:15:25.547220 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Role: member,reader Aug 31 19:15:25.547220 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Roles: member,reader Aug 31 19:15:25.548519 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/e3aa913bb25c45039643ce87bb84cbc2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e3aa913bb25c45039643ce87bb84cbc2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_e3aa913bb25c45039643ce87bb84cbc2", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e3aa913bb25c45039643ce87bb84cbc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:15:25.548519 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant: tempest-ServerRescueNegativeTestJSON-30468556 Aug 31 19:15:25.548519 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant-Id: e3aa913bb25c45039643ce87bb84cbc2 Aug 31 19:15:25.548519 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-30468556 Aug 31 19:15:25.548519 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User: tempest-ServerRescueNegativeTestJSON-30468556-project Aug 31 19:15:25.548519 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Id: default Aug 31 19:15:25.548519 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Name: Default Aug 31 19:15:25.548519 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Id: aa81a686e4324370a20e3fc35e5cc7a5 Aug 31 19:15:25.548519 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Name: tempest-ServerRescueNegativeTestJSON-30468556-project Aug 31 19:15:25.548519 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Aug 31 19:15:25.548519 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: {"volumeAttachment": {"volumeId": "9dd1a7fc-38e4-4c6e-a4f9-6851c21b43e8"}} Aug 31 19:15:25.548519 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: method: > Aug 31 19:15:25.549318 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: exception: Cannot 'attach_volume' instance 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 while it is in vm_state rescued Aug 31 19:15:25.549318 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: action_args: {'server_id': '28005e59-28f2-4e1e-a7d0-4ef68d9d6f48', 'body': {'volumeAttachment': {'volumeId': '9dd1a7fc-38e4-4c6e-a4f9-6851c21b43e8'}}} Aug 31 19:15:25.549318 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:15:25.549318 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:15:25.549318 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 19:15:25.549318 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 19:15:25.549318 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 19:15:25.549318 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 19:15:25.549318 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 19:15:25.549318 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 19:15:25.549318 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 31 19:15:25.549318 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:15:25.549318 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:15:25.549318 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:15:25.549318 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:15:25.549318 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:15:25.549318 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:15:25.549318 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:15:25.549318 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:15:25.550523 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:15:25.550523 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:15:25.550523 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 19:15:25.550523 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 19:15:25.550523 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 19:15:25.550523 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 19:15:25.550523 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 19:15:25.550523 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 19:15:25.550523 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 31 19:15:25.550523 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 19:15:25.550523 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 19:15:25.550523 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 19:15:25.550523 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 while it is in vm_state rescued Aug 31 19:15:25.550523 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:15:25.550523 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:15:25.550523 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:15:25.550523 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:15:25.550523 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:15:25.550523 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:15:25.551609 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:15:25.551609 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:15:25.551609 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 while it is in vm_state rescued Aug 31 19:15:25.551609 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:15:25.551609 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-cae6f9fa-d4e2-440b-98c9-c7f4389c9412 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Returning 409 to user: Cannot 'attach_volume' instance 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 while it is in vm_state rescued {{(pid=120623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:15:25.551609 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-cae6f9fa-d4e2-440b-98c9-c7f4389c9412 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "POST /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041616 Aug 31 19:15:25.551609 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 225/438] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 31 19:15:25 2022] POST /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48/os-volume_attachments => generated 152 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 19:15:25.558453 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-4e697b2b-ba45-4a35-8178-4aca4a2aa660 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:15:25.558982 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-4e697b2b-ba45-4a35-8178-4aca4a2aa660 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:25.565357 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4e697b2b-ba45-4a35-8178-4aca4a2aa660 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:25.565845 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4e697b2b-ba45-4a35-8178-4aca4a2aa660 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:25.566279 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4e697b2b-ba45-4a35-8178-4aca4a2aa660 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:25.566971 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4e697b2b-ba45-4a35-8178-4aca4a2aa660 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:25.567423 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4e697b2b-ba45-4a35-8178-4aca4a2aa660 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:25.567844 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4e697b2b-ba45-4a35-8178-4aca4a2aa660 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:25.648320 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-4e697b2b-ba45-4a35-8178-4aca4a2aa660 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "POST /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48/action" status: 202 len: 0 microversion: 2.1 time: 0.094170 Aug 31 19:15:25.651316 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 214/439] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 31 19:15:25 2022] POST /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:15:25.672968 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-4bfeec6a-85f9-4d96-9e4e-9e6b134bb420 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:25.673625 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-4bfeec6a-85f9-4d96-9e4e-9e6b134bb420 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:25.679819 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4bfeec6a-85f9-4d96-9e4e-9e6b134bb420 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:25.680399 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4bfeec6a-85f9-4d96-9e4e-9e6b134bb420 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:25.681246 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4bfeec6a-85f9-4d96-9e4e-9e6b134bb420 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:25.682552 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4bfeec6a-85f9-4d96-9e4e-9e6b134bb420 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:25.683015 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4bfeec6a-85f9-4d96-9e4e-9e6b134bb420 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:25.683474 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4bfeec6a-85f9-4d96-9e4e-9e6b134bb420 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:25.972653 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-4bfeec6a-85f9-4d96-9e4e-9e6b134bb420 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:25.984751 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-4bfeec6a-85f9-4d96-9e4e-9e6b134bb420 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48" status: 200 len: 1509 microversion: 2.1 time: 0.321320 Aug 31 19:15:25.998738 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 226/440] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:25 2022] GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 => generated 1509 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:26.211129 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-35c21425-a855-4cb1-a64d-df30ba2b9b56 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:26.212057 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-35c21425-a855-4cb1-a64d-df30ba2b9b56 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] [instance: d7634742-9448-4848-a138-5f3f352eb832] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:26.220756 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-35c21425-a855-4cb1-a64d-df30ba2b9b56 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:26.221856 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-35c21425-a855-4cb1-a64d-df30ba2b9b56 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:26.222450 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-35c21425-a855-4cb1-a64d-df30ba2b9b56 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:26.223334 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-35c21425-a855-4cb1-a64d-df30ba2b9b56 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:26.223942 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-35c21425-a855-4cb1-a64d-df30ba2b9b56 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:26.224521 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-35c21425-a855-4cb1-a64d-df30ba2b9b56 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:26.294868 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-4627f7f0-e524-4fd2-a321-c08a3a82948d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:26.296189 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-4627f7f0-e524-4fd2-a321-c08a3a82948d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 0582fb9e-35d5-48a2-852a-ddd8f3497903] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:26.302770 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4627f7f0-e524-4fd2-a321-c08a3a82948d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:26.303500 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4627f7f0-e524-4fd2-a321-c08a3a82948d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:26.303933 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4627f7f0-e524-4fd2-a321-c08a3a82948d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:26.304864 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4627f7f0-e524-4fd2-a321-c08a3a82948d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:26.305425 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4627f7f0-e524-4fd2-a321-c08a3a82948d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:26.305854 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4627f7f0-e524-4fd2-a321-c08a3a82948d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:26.364462 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-35c21425-a855-4cb1-a64d-df30ba2b9b56 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426bb2c78bce40179a0a115651b81a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e4dacbe64a48f49f697787961e1200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:26.372793 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-35c21425-a855-4cb1-a64d-df30ba2b9b56 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] 10.222.0.65 "GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832" status: 200 len: 1314 microversion: 2.1 time: 0.166499 Aug 31 19:15:26.373387 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 215/441] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:26 2022] GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:26.439918 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-4627f7f0-e524-4fd2-a321-c08a3a82948d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:26.448625 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-4627f7f0-e524-4fd2-a321-c08a3a82948d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903" status: 200 len: 1313 microversion: 2.1 time: 0.158312 Aug 31 19:15:26.449208 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 227/442] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:26 2022] GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:15:27.007610 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-35fdd729-b291-439d-88c8-542d56934940 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:27.008224 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-35fdd729-b291-439d-88c8-542d56934940 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:27.014832 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-35fdd729-b291-439d-88c8-542d56934940 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:27.015313 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-35fdd729-b291-439d-88c8-542d56934940 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:27.015747 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-35fdd729-b291-439d-88c8-542d56934940 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:27.016432 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-35fdd729-b291-439d-88c8-542d56934940 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:27.016888 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-35fdd729-b291-439d-88c8-542d56934940 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:27.017340 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-35fdd729-b291-439d-88c8-542d56934940 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:27.150734 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-35fdd729-b291-439d-88c8-542d56934940 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:27.159895 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-35fdd729-b291-439d-88c8-542d56934940 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48" status: 200 len: 1509 microversion: 2.1 time: 0.155656 Aug 31 19:15:27.160484 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 216/443] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:27 2022] GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:27.393608 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-35a913ef-82c3-43f6-954d-8b2592cda91b tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:27.394141 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-35a913ef-82c3-43f6-954d-8b2592cda91b tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] [instance: d7634742-9448-4848-a138-5f3f352eb832] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:27.400226 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-35a913ef-82c3-43f6-954d-8b2592cda91b tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:27.400712 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-35a913ef-82c3-43f6-954d-8b2592cda91b tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:27.401150 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-35a913ef-82c3-43f6-954d-8b2592cda91b tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:27.401868 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-35a913ef-82c3-43f6-954d-8b2592cda91b tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:27.402324 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-35a913ef-82c3-43f6-954d-8b2592cda91b tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:27.402747 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-35a913ef-82c3-43f6-954d-8b2592cda91b tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:27.469172 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-4ad7c51f-2895-4d6e-b610-2d2ac4db89f2 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:27.471351 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-4ad7c51f-2895-4d6e-b610-2d2ac4db89f2 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 0582fb9e-35d5-48a2-852a-ddd8f3497903] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:27.481848 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4ad7c51f-2895-4d6e-b610-2d2ac4db89f2 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:27.482637 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4ad7c51f-2895-4d6e-b610-2d2ac4db89f2 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:27.483078 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4ad7c51f-2895-4d6e-b610-2d2ac4db89f2 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:27.484181 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4ad7c51f-2895-4d6e-b610-2d2ac4db89f2 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:27.484405 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4ad7c51f-2895-4d6e-b610-2d2ac4db89f2 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:27.484834 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4ad7c51f-2895-4d6e-b610-2d2ac4db89f2 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:27.567113 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-35a913ef-82c3-43f6-954d-8b2592cda91b tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426bb2c78bce40179a0a115651b81a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e4dacbe64a48f49f697787961e1200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:27.580379 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-35a913ef-82c3-43f6-954d-8b2592cda91b tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] 10.222.0.65 "GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832" status: 200 len: 1314 microversion: 2.1 time: 0.190667 Aug 31 19:15:27.595030 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 228/444] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:27 2022] GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:27.648430 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-4ad7c51f-2895-4d6e-b610-2d2ac4db89f2 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:27.657449 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-4ad7c51f-2895-4d6e-b610-2d2ac4db89f2 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903" status: 200 len: 1496 microversion: 2.1 time: 0.192314 Aug 31 19:15:27.658021 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 217/445] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:27 2022] GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903 => generated 1496 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:15:28.179818 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-65f5e911-341d-40f2-a334-b87d5037ecc5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:28.180449 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-65f5e911-341d-40f2-a334-b87d5037ecc5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:28.186577 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-65f5e911-341d-40f2-a334-b87d5037ecc5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:28.187063 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-65f5e911-341d-40f2-a334-b87d5037ecc5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:28.187499 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-65f5e911-341d-40f2-a334-b87d5037ecc5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:28.188183 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-65f5e911-341d-40f2-a334-b87d5037ecc5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:28.188639 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-65f5e911-341d-40f2-a334-b87d5037ecc5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:28.189061 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-65f5e911-341d-40f2-a334-b87d5037ecc5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:28.317521 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-fa5da3a8-a889-486d-ae37-e50aa2bd50c4 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:28.318011 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-fa5da3a8-a889-486d-ae37-e50aa2bd50c4 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 0582fb9e-35d5-48a2-852a-ddd8f3497903] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:28.321706 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-65f5e911-341d-40f2-a334-b87d5037ecc5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:28.323954 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fa5da3a8-a889-486d-ae37-e50aa2bd50c4 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:28.324429 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fa5da3a8-a889-486d-ae37-e50aa2bd50c4 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:28.324848 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fa5da3a8-a889-486d-ae37-e50aa2bd50c4 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:28.325839 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fa5da3a8-a889-486d-ae37-e50aa2bd50c4 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:28.326289 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fa5da3a8-a889-486d-ae37-e50aa2bd50c4 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:28.326698 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fa5da3a8-a889-486d-ae37-e50aa2bd50c4 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:28.329984 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-65f5e911-341d-40f2-a334-b87d5037ecc5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48" status: 200 len: 1509 microversion: 2.1 time: 0.153978 Aug 31 19:15:28.330627 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 229/446] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:28 2022] GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:28.352046 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-fa5da3a8-a889-486d-ae37-e50aa2bd50c4 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 0582fb9e-35d5-48a2-852a-ddd8f3497903] Going to try to terminate instance {{(pid=120624) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 19:15:28.434812 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-fa5da3a8-a889-486d-ae37-e50aa2bd50c4 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "DELETE /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903" status: 204 len: 0 microversion: 2.1 time: 0.120815 Aug 31 19:15:28.435376 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 218/447] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 31 19:15:28 2022] DELETE /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:15:28.443567 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-b8349fa7-69a6-4b6a-9d4f-f9226ea319ad tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:28.444101 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-b8349fa7-69a6-4b6a-9d4f-f9226ea319ad tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 0582fb9e-35d5-48a2-852a-ddd8f3497903] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:28.450454 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b8349fa7-69a6-4b6a-9d4f-f9226ea319ad tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:28.450937 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b8349fa7-69a6-4b6a-9d4f-f9226ea319ad tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:28.451369 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b8349fa7-69a6-4b6a-9d4f-f9226ea319ad tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:28.452050 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b8349fa7-69a6-4b6a-9d4f-f9226ea319ad tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:28.452503 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b8349fa7-69a6-4b6a-9d4f-f9226ea319ad tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:28.452940 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b8349fa7-69a6-4b6a-9d4f-f9226ea319ad tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:28.582351 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-b8349fa7-69a6-4b6a-9d4f-f9226ea319ad tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:28.590671 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-b8349fa7-69a6-4b6a-9d4f-f9226ea319ad tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903" status: 200 len: 1502 microversion: 2.1 time: 0.151016 Aug 31 19:15:28.591223 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 230/448] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:28 2022] GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903 => generated 1502 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:28.601481 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-e218c705-2a6a-46a2-8ba7-54ae18cf0cb6 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:28.602169 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-e218c705-2a6a-46a2-8ba7-54ae18cf0cb6 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] [instance: d7634742-9448-4848-a138-5f3f352eb832] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:28.608735 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e218c705-2a6a-46a2-8ba7-54ae18cf0cb6 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:28.609238 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e218c705-2a6a-46a2-8ba7-54ae18cf0cb6 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:28.609675 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e218c705-2a6a-46a2-8ba7-54ae18cf0cb6 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:28.610356 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e218c705-2a6a-46a2-8ba7-54ae18cf0cb6 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:28.610805 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e218c705-2a6a-46a2-8ba7-54ae18cf0cb6 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:28.611223 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e218c705-2a6a-46a2-8ba7-54ae18cf0cb6 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:28.742934 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-e218c705-2a6a-46a2-8ba7-54ae18cf0cb6 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426bb2c78bce40179a0a115651b81a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e4dacbe64a48f49f697787961e1200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:28.751992 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-e218c705-2a6a-46a2-8ba7-54ae18cf0cb6 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] 10.222.0.65 "GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832" status: 200 len: 1314 microversion: 2.1 time: 0.154643 Aug 31 19:15:28.752678 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 219/449] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:28 2022] GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:29.350890 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-6db567a4-e8ec-408a-9dd3-483f95f7fbe2 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:29.351630 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-6db567a4-e8ec-408a-9dd3-483f95f7fbe2 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:29.358321 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6db567a4-e8ec-408a-9dd3-483f95f7fbe2 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:29.358806 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6db567a4-e8ec-408a-9dd3-483f95f7fbe2 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:29.359233 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6db567a4-e8ec-408a-9dd3-483f95f7fbe2 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:29.359928 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6db567a4-e8ec-408a-9dd3-483f95f7fbe2 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:29.360379 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6db567a4-e8ec-408a-9dd3-483f95f7fbe2 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:29.360798 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6db567a4-e8ec-408a-9dd3-483f95f7fbe2 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:29.506677 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-6db567a4-e8ec-408a-9dd3-483f95f7fbe2 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:29.517311 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-6db567a4-e8ec-408a-9dd3-483f95f7fbe2 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48" status: 200 len: 1509 microversion: 2.1 time: 0.167769 Aug 31 19:15:29.517311 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 231/450] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:29 2022] GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 => generated 1509 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:29.612099 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-dd921ded-b227-49de-97a6-d33362bf4096 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:29.612714 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-dd921ded-b227-49de-97a6-d33362bf4096 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 0582fb9e-35d5-48a2-852a-ddd8f3497903] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:29.620107 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dd921ded-b227-49de-97a6-d33362bf4096 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:29.620573 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dd921ded-b227-49de-97a6-d33362bf4096 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:29.621058 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dd921ded-b227-49de-97a6-d33362bf4096 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:29.621988 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dd921ded-b227-49de-97a6-d33362bf4096 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:29.622501 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dd921ded-b227-49de-97a6-d33362bf4096 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:29.623030 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dd921ded-b227-49de-97a6-d33362bf4096 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:29.766046 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-dd921ded-b227-49de-97a6-d33362bf4096 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:29.773610 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e3ceadd5-7daa-4d50-898a-6efe5968a822 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:29.774224 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-e3ceadd5-7daa-4d50-898a-6efe5968a822 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] [instance: d7634742-9448-4848-a138-5f3f352eb832] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:29.774578 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-dd921ded-b227-49de-97a6-d33362bf4096 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903" status: 200 len: 1502 microversion: 2.1 time: 0.166707 Aug 31 19:15:29.775669 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 220/451] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:29 2022] GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903 => generated 1502 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:29.780793 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e3ceadd5-7daa-4d50-898a-6efe5968a822 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:29.781307 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e3ceadd5-7daa-4d50-898a-6efe5968a822 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:29.781744 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e3ceadd5-7daa-4d50-898a-6efe5968a822 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:29.782433 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e3ceadd5-7daa-4d50-898a-6efe5968a822 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:29.782886 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e3ceadd5-7daa-4d50-898a-6efe5968a822 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:29.783310 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e3ceadd5-7daa-4d50-898a-6efe5968a822 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:29.803332 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=100 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:15:29.954312 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e3ceadd5-7daa-4d50-898a-6efe5968a822 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426bb2c78bce40179a0a115651b81a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e4dacbe64a48f49f697787961e1200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:29.962035 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-e3ceadd5-7daa-4d50-898a-6efe5968a822 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] 10.222.0.65 "GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832" status: 200 len: 1314 microversion: 2.1 time: 0.192356 Aug 31 19:15:29.963260 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 232/452] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:29 2022] GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:30.534711 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-8c673ca4-6c47-4d90-9b92-ad93e48bf98c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:30.535267 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-8c673ca4-6c47-4d90-9b92-ad93e48bf98c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:30.542755 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8c673ca4-6c47-4d90-9b92-ad93e48bf98c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:30.543232 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8c673ca4-6c47-4d90-9b92-ad93e48bf98c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:30.543662 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8c673ca4-6c47-4d90-9b92-ad93e48bf98c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:30.544508 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8c673ca4-6c47-4d90-9b92-ad93e48bf98c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:30.545108 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8c673ca4-6c47-4d90-9b92-ad93e48bf98c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:30.545700 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8c673ca4-6c47-4d90-9b92-ad93e48bf98c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:30.683309 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-8c673ca4-6c47-4d90-9b92-ad93e48bf98c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:30.691666 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-8c673ca4-6c47-4d90-9b92-ad93e48bf98c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48" status: 200 len: 1509 microversion: 2.1 time: 0.160800 Aug 31 19:15:30.692372 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 221/453] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:30 2022] GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:30.700830 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e626880b-4997-4ecb-ab52-32b0de4bda4c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-59207414", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1231074008", "security_groups": [{"name": "tempest-secgroup-smoke-1654778003"}], "networks": [{"uuid": "a7f49d00-97b8-4f1a-bb2a-66ce758dfa71"}], "block_device_mapping_v2": [{"uuid": "cbd8fd58-bd79-4719-b8f6-abbb6644d1ec", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:15:30.796799 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-e7a4ee07-5ed6-4575-8f4e-42d6cafb8175 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:30.797340 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-e7a4ee07-5ed6-4575-8f4e-42d6cafb8175 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 0582fb9e-35d5-48a2-852a-ddd8f3497903] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:30.804383 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e7a4ee07-5ed6-4575-8f4e-42d6cafb8175 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:30.804873 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e7a4ee07-5ed6-4575-8f4e-42d6cafb8175 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:30.805409 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e7a4ee07-5ed6-4575-8f4e-42d6cafb8175 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:30.806137 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e7a4ee07-5ed6-4575-8f4e-42d6cafb8175 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:30.807316 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e7a4ee07-5ed6-4575-8f4e-42d6cafb8175 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:30.807741 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e7a4ee07-5ed6-4575-8f4e-42d6cafb8175 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:30.826631 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.network.neutron [None req-e626880b-4997-4ecb-ab52-32b0de4bda4c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] validate_networks() for [('a7f49d00-97b8-4f1a-bb2a-66ce758dfa71', None, None, None, None, None)] {{(pid=120623) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:15:30.969750 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-e7a4ee07-5ed6-4575-8f4e-42d6cafb8175 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:30.978131 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-e7a4ee07-5ed6-4575-8f4e-42d6cafb8175 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903" status: 200 len: 1502 microversion: 2.1 time: 0.185294 Aug 31 19:15:30.979397 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 222/454] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:30 2022] GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903 => generated 1502 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:15:30.990472 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-ac3a863b-0229-4afa-acdc-89a1695c954d tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:30.991109 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-ac3a863b-0229-4afa-acdc-89a1695c954d tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] [instance: d7634742-9448-4848-a138-5f3f352eb832] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:30.998557 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ac3a863b-0229-4afa-acdc-89a1695c954d tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:30.999121 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ac3a863b-0229-4afa-acdc-89a1695c954d tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:30.999739 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ac3a863b-0229-4afa-acdc-89a1695c954d tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:31.000618 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ac3a863b-0229-4afa-acdc-89a1695c954d tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:31.001068 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ac3a863b-0229-4afa-acdc-89a1695c954d tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:31.001579 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ac3a863b-0229-4afa-acdc-89a1695c954d tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:31.141840 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-ac3a863b-0229-4afa-acdc-89a1695c954d tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426bb2c78bce40179a0a115651b81a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e4dacbe64a48f49f697787961e1200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:31.149631 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-ac3a863b-0229-4afa-acdc-89a1695c954d tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] 10.222.0.65 "GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832" status: 200 len: 1314 microversion: 2.1 time: 0.163125 Aug 31 19:15:31.150956 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 223/455] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:30 2022] GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:31.237759 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-e626880b-4997-4ecb-ab52-32b0de4bda4c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Flavor limits 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:15:31.238181 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-e626880b-4997-4ecb-ab52-32b0de4bda4c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Image limits 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:15:31.238648 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-e626880b-4997-4ecb-ab52-32b0de4bda4c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Flavor pref 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:15:31.239079 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-e626880b-4997-4ecb-ab52-32b0de4bda4c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Image pref 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:15:31.239802 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-e626880b-4997-4ecb-ab52-32b0de4bda4c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:15:31.250555 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e626880b-4997-4ecb-ab52-32b0de4bda4c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:31.251036 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e626880b-4997-4ecb-ab52-32b0de4bda4c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:31.251517 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e626880b-4997-4ecb-ab52-32b0de4bda4c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:31.252243 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e626880b-4997-4ecb-ab52-32b0de4bda4c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:31.252696 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e626880b-4997-4ecb-ab52-32b0de4bda4c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:31.253116 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e626880b-4997-4ecb-ab52-32b0de4bda4c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:31.273121 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.quota [None req-e626880b-4997-4ecb-ab52-32b0de4bda4c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Getting quotas for project fe3b687e68734a8888291f0c3527acbc. Resources: {'instances', 'cores', 'ram'} {{(pid=120623) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:15:31.287192 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.quota [None req-e626880b-4997-4ecb-ab52-32b0de4bda4c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Getting quotas for user 26cd75e2c118412a88bb354e18863d34 and project fe3b687e68734a8888291f0c3527acbc. Resources: {'instances', 'cores', 'ram'} {{(pid=120623) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:15:31.334439 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-e626880b-4997-4ecb-ab52-32b0de4bda4c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Going to run 1 instances... {{(pid=120623) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:15:31.336643 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-e626880b-4997-4ecb-ab52-32b0de4bda4c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cbd8fd58-bd79-4719-b8f6-abbb6644d1ec',volume_size=None,volume_type=None)] {{(pid=120623) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:15:31.475722 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-e626880b-4997-4ecb-ab52-32b0de4bda4c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.778661 Aug 31 19:15:31.476757 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 233/456] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 31 19:15:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 780 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 19:15:31.489366 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-4c49b6ec-7fd7-4472-8c9f-60902519496a tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:31.490236 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-4c49b6ec-7fd7-4472-8c9f-60902519496a tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:31.558901 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-4c49b6ec-7fd7-4472-8c9f-60902519496a tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:31.567610 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-4c49b6ec-7fd7-4472-8c9f-60902519496a tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1087 microversion: 2.1 time: 0.082044 Aug 31 19:15:31.568379 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 224/457] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:31 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1087 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:31.712444 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-c9372790-49bf-491f-aa6b-fc64af7664a6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:31.713786 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-c9372790-49bf-491f-aa6b-fc64af7664a6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:31.720097 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c9372790-49bf-491f-aa6b-fc64af7664a6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:31.720610 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c9372790-49bf-491f-aa6b-fc64af7664a6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:31.721296 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c9372790-49bf-491f-aa6b-fc64af7664a6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:31.722168 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c9372790-49bf-491f-aa6b-fc64af7664a6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:31.722831 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c9372790-49bf-491f-aa6b-fc64af7664a6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:31.723209 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c9372790-49bf-491f-aa6b-fc64af7664a6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:31.893169 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-c9372790-49bf-491f-aa6b-fc64af7664a6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:31.902563 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-c9372790-49bf-491f-aa6b-fc64af7664a6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48" status: 200 len: 1509 microversion: 2.1 time: 0.193877 Aug 31 19:15:31.903816 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 234/458] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:31 2022] GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 => generated 1509 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:32.000235 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-2d360656-7eab-4a8c-8253-1b37166ecc15 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:32.001426 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-2d360656-7eab-4a8c-8253-1b37166ecc15 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 0582fb9e-35d5-48a2-852a-ddd8f3497903] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:32.008693 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2d360656-7eab-4a8c-8253-1b37166ecc15 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:32.009327 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2d360656-7eab-4a8c-8253-1b37166ecc15 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:32.010613 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2d360656-7eab-4a8c-8253-1b37166ecc15 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:32.011386 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2d360656-7eab-4a8c-8253-1b37166ecc15 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:32.011884 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2d360656-7eab-4a8c-8253-1b37166ecc15 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:32.012350 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2d360656-7eab-4a8c-8253-1b37166ecc15 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:32.150225 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-2d360656-7eab-4a8c-8253-1b37166ecc15 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:32.158267 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-2d360656-7eab-4a8c-8253-1b37166ecc15 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903" status: 200 len: 1502 microversion: 2.1 time: 0.161765 Aug 31 19:15:32.158910 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 225/459] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:31 2022] GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903 => generated 1502 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:32.175135 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-0bcfc831-accb-456c-b35b-14b0b97a35d4 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:32.175735 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-0bcfc831-accb-456c-b35b-14b0b97a35d4 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] [instance: d7634742-9448-4848-a138-5f3f352eb832] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:32.181749 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0bcfc831-accb-456c-b35b-14b0b97a35d4 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:32.182776 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0bcfc831-accb-456c-b35b-14b0b97a35d4 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:32.183201 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0bcfc831-accb-456c-b35b-14b0b97a35d4 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:32.183876 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0bcfc831-accb-456c-b35b-14b0b97a35d4 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:32.184320 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0bcfc831-accb-456c-b35b-14b0b97a35d4 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:32.184733 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0bcfc831-accb-456c-b35b-14b0b97a35d4 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:32.318694 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-0bcfc831-accb-456c-b35b-14b0b97a35d4 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426bb2c78bce40179a0a115651b81a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e4dacbe64a48f49f697787961e1200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:32.326400 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-0bcfc831-accb-456c-b35b-14b0b97a35d4 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] 10.222.0.65 "GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832" status: 200 len: 1314 microversion: 2.1 time: 0.155239 Aug 31 19:15:32.330781 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 235/460] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:32 2022] GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:32.590087 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-7ed77376-0aa5-4a1d-89b5-6fd58878476b tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:32.590717 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-7ed77376-0aa5-4a1d-89b5-6fd58878476b tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:32.596534 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7ed77376-0aa5-4a1d-89b5-6fd58878476b tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:32.597124 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7ed77376-0aa5-4a1d-89b5-6fd58878476b tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:32.597583 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7ed77376-0aa5-4a1d-89b5-6fd58878476b tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:32.598257 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7ed77376-0aa5-4a1d-89b5-6fd58878476b tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:32.598709 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7ed77376-0aa5-4a1d-89b5-6fd58878476b tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:32.599123 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7ed77376-0aa5-4a1d-89b5-6fd58878476b tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:32.665342 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-7ed77376-0aa5-4a1d-89b5-6fd58878476b tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:32.674261 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-7ed77376-0aa5-4a1d-89b5-6fd58878476b tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1137 microversion: 2.1 time: 0.089077 Aug 31 19:15:32.674820 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 226/461] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:32 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1137 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:15:32.924181 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-11d2a571-5758-4ca8-a2a7-fe48c273c8a7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:32.924888 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-11d2a571-5758-4ca8-a2a7-fe48c273c8a7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:32.931159 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-11d2a571-5758-4ca8-a2a7-fe48c273c8a7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:32.931646 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-11d2a571-5758-4ca8-a2a7-fe48c273c8a7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:32.932077 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-11d2a571-5758-4ca8-a2a7-fe48c273c8a7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:32.932824 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-11d2a571-5758-4ca8-a2a7-fe48c273c8a7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:32.933311 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-11d2a571-5758-4ca8-a2a7-fe48c273c8a7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:32.933736 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-11d2a571-5758-4ca8-a2a7-fe48c273c8a7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:33.080500 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-11d2a571-5758-4ca8-a2a7-fe48c273c8a7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:33.107917 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-11d2a571-5758-4ca8-a2a7-fe48c273c8a7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48" status: 200 len: 1509 microversion: 2.1 time: 0.187401 Aug 31 19:15:33.108892 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 236/462] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:32 2022] GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 => generated 1509 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:33.179809 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-25da9640-cfa1-4c7e-8e05-cd59a3f203a4 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:33.180947 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-25da9640-cfa1-4c7e-8e05-cd59a3f203a4 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 0582fb9e-35d5-48a2-852a-ddd8f3497903] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:33.187679 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-25da9640-cfa1-4c7e-8e05-cd59a3f203a4 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:33.188161 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-25da9640-cfa1-4c7e-8e05-cd59a3f203a4 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:33.188775 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-25da9640-cfa1-4c7e-8e05-cd59a3f203a4 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:33.189545 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-25da9640-cfa1-4c7e-8e05-cd59a3f203a4 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:33.190170 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-25da9640-cfa1-4c7e-8e05-cd59a3f203a4 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:33.190740 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-25da9640-cfa1-4c7e-8e05-cd59a3f203a4 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:33.346913 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-12aceb53-e961-47b8-ac8c-34564e8ecff9 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:33.347621 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-12aceb53-e961-47b8-ac8c-34564e8ecff9 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] [instance: d7634742-9448-4848-a138-5f3f352eb832] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:33.369159 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-12aceb53-e961-47b8-ac8c-34564e8ecff9 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:33.369159 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-12aceb53-e961-47b8-ac8c-34564e8ecff9 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:33.369159 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-12aceb53-e961-47b8-ac8c-34564e8ecff9 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:33.369159 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-12aceb53-e961-47b8-ac8c-34564e8ecff9 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:33.369518 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-12aceb53-e961-47b8-ac8c-34564e8ecff9 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:33.370118 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-25da9640-cfa1-4c7e-8e05-cd59a3f203a4 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:33.370221 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-12aceb53-e961-47b8-ac8c-34564e8ecff9 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:33.377432 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-25da9640-cfa1-4c7e-8e05-cd59a3f203a4 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903" status: 200 len: 1502 microversion: 2.1 time: 0.201245 Aug 31 19:15:33.378167 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 227/463] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:33 2022] GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903 => generated 1502 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:33.520261 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-12aceb53-e961-47b8-ac8c-34564e8ecff9 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426bb2c78bce40179a0a115651b81a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e4dacbe64a48f49f697787961e1200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:33.528497 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-12aceb53-e961-47b8-ac8c-34564e8ecff9 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] 10.222.0.65 "GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832" status: 200 len: 1314 microversion: 2.1 time: 0.185414 Aug 31 19:15:33.529283 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 237/464] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:33 2022] GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:33.694225 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-94f3cf6e-7924-4a00-bcac-e9019d55db3c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:33.695093 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-94f3cf6e-7924-4a00-bcac-e9019d55db3c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:33.702732 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-94f3cf6e-7924-4a00-bcac-e9019d55db3c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:33.703338 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-94f3cf6e-7924-4a00-bcac-e9019d55db3c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:33.703923 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-94f3cf6e-7924-4a00-bcac-e9019d55db3c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:33.704846 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-94f3cf6e-7924-4a00-bcac-e9019d55db3c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:33.705335 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-94f3cf6e-7924-4a00-bcac-e9019d55db3c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:33.705760 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-94f3cf6e-7924-4a00-bcac-e9019d55db3c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:33.710784 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:15:33.777719 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-94f3cf6e-7924-4a00-bcac-e9019d55db3c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:33.785353 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-94f3cf6e-7924-4a00-bcac-e9019d55db3c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1137 microversion: 2.1 time: 0.095060 Aug 31 19:15:33.785904 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 228/465] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:33 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1137 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:34.132283 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e360b45e-750b-424d-96e3-0b6cd36b13d4 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:34.132931 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-e360b45e-750b-424d-96e3-0b6cd36b13d4 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:34.139033 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e360b45e-750b-424d-96e3-0b6cd36b13d4 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:34.139526 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e360b45e-750b-424d-96e3-0b6cd36b13d4 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:34.139961 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e360b45e-750b-424d-96e3-0b6cd36b13d4 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:34.140656 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e360b45e-750b-424d-96e3-0b6cd36b13d4 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:34.141111 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e360b45e-750b-424d-96e3-0b6cd36b13d4 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:34.141617 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e360b45e-750b-424d-96e3-0b6cd36b13d4 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:34.296841 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e360b45e-750b-424d-96e3-0b6cd36b13d4 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:34.305129 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-e360b45e-750b-424d-96e3-0b6cd36b13d4 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48" status: 200 len: 1509 microversion: 2.1 time: 0.176685 Aug 31 19:15:34.306938 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 238/466] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:34 2022] GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 => generated 1509 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:34.402171 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-d99b7a1a-43d6-45f9-9c1e-be10f3ebb5d0 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:34.402982 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-d99b7a1a-43d6-45f9-9c1e-be10f3ebb5d0 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 0582fb9e-35d5-48a2-852a-ddd8f3497903] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:34.409263 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d99b7a1a-43d6-45f9-9c1e-be10f3ebb5d0 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:34.409747 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d99b7a1a-43d6-45f9-9c1e-be10f3ebb5d0 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:34.410165 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d99b7a1a-43d6-45f9-9c1e-be10f3ebb5d0 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:34.410836 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d99b7a1a-43d6-45f9-9c1e-be10f3ebb5d0 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:34.411278 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d99b7a1a-43d6-45f9-9c1e-be10f3ebb5d0 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:34.411687 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d99b7a1a-43d6-45f9-9c1e-be10f3ebb5d0 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:34.544659 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-d99b7a1a-43d6-45f9-9c1e-be10f3ebb5d0 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:34.550366 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-f3298bde-1d31-49a4-8f33-3ec9b4165dfb tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:34.551003 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-f3298bde-1d31-49a4-8f33-3ec9b4165dfb tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] [instance: d7634742-9448-4848-a138-5f3f352eb832] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:34.551117 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-d99b7a1a-43d6-45f9-9c1e-be10f3ebb5d0 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903" status: 200 len: 1502 microversion: 2.1 time: 0.153491 Aug 31 19:15:34.551570 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 229/467] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:34 2022] GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903 => generated 1502 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:34.558725 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f3298bde-1d31-49a4-8f33-3ec9b4165dfb tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:34.559231 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f3298bde-1d31-49a4-8f33-3ec9b4165dfb tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:34.559659 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f3298bde-1d31-49a4-8f33-3ec9b4165dfb tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:34.560547 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f3298bde-1d31-49a4-8f33-3ec9b4165dfb tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:34.560789 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f3298bde-1d31-49a4-8f33-3ec9b4165dfb tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:34.561226 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f3298bde-1d31-49a4-8f33-3ec9b4165dfb tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:34.695668 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-f3298bde-1d31-49a4-8f33-3ec9b4165dfb tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426bb2c78bce40179a0a115651b81a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e4dacbe64a48f49f697787961e1200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:34.703822 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-f3298bde-1d31-49a4-8f33-3ec9b4165dfb tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] 10.222.0.65 "GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832" status: 200 len: 1314 microversion: 2.1 time: 0.157764 Aug 31 19:15:34.704460 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 239/468] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:34 2022] GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:15:34.806578 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-3ce33faa-d467-40f2-a4a7-a447d4503e96 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:34.807696 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-3ce33faa-d467-40f2-a4a7-a447d4503e96 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:34.813590 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3ce33faa-d467-40f2-a4a7-a447d4503e96 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:34.814069 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3ce33faa-d467-40f2-a4a7-a447d4503e96 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:34.814517 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3ce33faa-d467-40f2-a4a7-a447d4503e96 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:34.815188 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3ce33faa-d467-40f2-a4a7-a447d4503e96 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:34.815638 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3ce33faa-d467-40f2-a4a7-a447d4503e96 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:34.816058 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3ce33faa-d467-40f2-a4a7-a447d4503e96 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:34.878326 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-3ce33faa-d467-40f2-a4a7-a447d4503e96 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:34.886678 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-3ce33faa-d467-40f2-a4a7-a447d4503e96 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1137 microversion: 2.1 time: 0.083996 Aug 31 19:15:34.887235 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 230/469] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:34 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1137 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:35.335637 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-765aad17-f3e7-4769-aa96-eef15382ae15 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:35.336250 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-765aad17-f3e7-4769-aa96-eef15382ae15 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:35.342352 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-765aad17-f3e7-4769-aa96-eef15382ae15 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:35.342840 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-765aad17-f3e7-4769-aa96-eef15382ae15 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:35.343276 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-765aad17-f3e7-4769-aa96-eef15382ae15 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:35.343966 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-765aad17-f3e7-4769-aa96-eef15382ae15 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:35.344419 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-765aad17-f3e7-4769-aa96-eef15382ae15 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:35.344841 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-765aad17-f3e7-4769-aa96-eef15382ae15 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:35.470900 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-765aad17-f3e7-4769-aa96-eef15382ae15 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:35.478768 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-765aad17-f3e7-4769-aa96-eef15382ae15 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48" status: 200 len: 1509 microversion: 2.1 time: 0.147021 Aug 31 19:15:35.479840 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 240/470] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:35 2022] GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 => generated 1509 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:35.571999 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-f0eac9db-0fb3-46b8-ac3b-11e56cbe289b tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:35.572736 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-f0eac9db-0fb3-46b8-ac3b-11e56cbe289b tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 0582fb9e-35d5-48a2-852a-ddd8f3497903] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:35.579245 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f0eac9db-0fb3-46b8-ac3b-11e56cbe289b tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:35.579798 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f0eac9db-0fb3-46b8-ac3b-11e56cbe289b tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:35.580297 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f0eac9db-0fb3-46b8-ac3b-11e56cbe289b tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:35.581051 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f0eac9db-0fb3-46b8-ac3b-11e56cbe289b tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:35.581584 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f0eac9db-0fb3-46b8-ac3b-11e56cbe289b tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:35.582073 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f0eac9db-0fb3-46b8-ac3b-11e56cbe289b tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:35.709632 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-f0eac9db-0fb3-46b8-ac3b-11e56cbe289b tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:35.717751 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-f0eac9db-0fb3-46b8-ac3b-11e56cbe289b tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903" status: 200 len: 1502 microversion: 2.1 time: 0.149689 Aug 31 19:15:35.718309 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 231/471] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:35 2022] GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903 => generated 1502 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:35.723746 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-951b9551-363b-42ce-876c-df5d38e460d7 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:35.724291 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-951b9551-363b-42ce-876c-df5d38e460d7 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] [instance: d7634742-9448-4848-a138-5f3f352eb832] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:35.731076 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-951b9551-363b-42ce-876c-df5d38e460d7 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:35.731589 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-951b9551-363b-42ce-876c-df5d38e460d7 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:35.732018 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-951b9551-363b-42ce-876c-df5d38e460d7 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:35.732708 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-951b9551-363b-42ce-876c-df5d38e460d7 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:35.733164 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-951b9551-363b-42ce-876c-df5d38e460d7 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:35.733621 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-951b9551-363b-42ce-876c-df5d38e460d7 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:35.865004 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-951b9551-363b-42ce-876c-df5d38e460d7 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426bb2c78bce40179a0a115651b81a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e4dacbe64a48f49f697787961e1200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:35.872633 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-951b9551-363b-42ce-876c-df5d38e460d7 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] 10.222.0.65 "GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832" status: 200 len: 1314 microversion: 2.1 time: 0.152739 Aug 31 19:15:35.873217 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 241/472] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:35 2022] GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:35.907353 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-e0d27995-ef1c-4b79-b044-cb53c85b99f3 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:35.907961 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-e0d27995-ef1c-4b79-b044-cb53c85b99f3 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:35.914294 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e0d27995-ef1c-4b79-b044-cb53c85b99f3 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:35.914775 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e0d27995-ef1c-4b79-b044-cb53c85b99f3 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:35.915394 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e0d27995-ef1c-4b79-b044-cb53c85b99f3 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:35.916080 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e0d27995-ef1c-4b79-b044-cb53c85b99f3 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:35.916561 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e0d27995-ef1c-4b79-b044-cb53c85b99f3 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:35.916976 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e0d27995-ef1c-4b79-b044-cb53c85b99f3 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:35.978776 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-e0d27995-ef1c-4b79-b044-cb53c85b99f3 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:35.986743 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-e0d27995-ef1c-4b79-b044-cb53c85b99f3 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1137 microversion: 2.1 time: 0.083251 Aug 31 19:15:35.987300 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 232/473] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:35 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1137 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:36.501616 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d4ba57b0-589b-4e78-8c03-9290dc8463c5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:36.502309 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d4ba57b0-589b-4e78-8c03-9290dc8463c5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:36.508500 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d4ba57b0-589b-4e78-8c03-9290dc8463c5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:36.508984 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d4ba57b0-589b-4e78-8c03-9290dc8463c5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:36.509525 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d4ba57b0-589b-4e78-8c03-9290dc8463c5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:36.510132 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d4ba57b0-589b-4e78-8c03-9290dc8463c5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:36.511245 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d4ba57b0-589b-4e78-8c03-9290dc8463c5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:36.511667 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d4ba57b0-589b-4e78-8c03-9290dc8463c5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:36.653407 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-d4ba57b0-589b-4e78-8c03-9290dc8463c5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:36.661336 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-d4ba57b0-589b-4e78-8c03-9290dc8463c5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48" status: 200 len: 1509 microversion: 2.1 time: 0.163479 Aug 31 19:15:36.661917 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 242/474] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:36 2022] GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:36.739748 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-cd2368d3-2664-49b0-b447-be655588f15f tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:36.740388 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-cd2368d3-2664-49b0-b447-be655588f15f tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 0582fb9e-35d5-48a2-852a-ddd8f3497903] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:36.747932 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cd2368d3-2664-49b0-b447-be655588f15f tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:36.748142 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cd2368d3-2664-49b0-b447-be655588f15f tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:36.748451 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cd2368d3-2664-49b0-b447-be655588f15f tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:36.749145 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cd2368d3-2664-49b0-b447-be655588f15f tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:36.749624 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cd2368d3-2664-49b0-b447-be655588f15f tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:36.750052 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cd2368d3-2664-49b0-b447-be655588f15f tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:36.889301 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-cd2368d3-2664-49b0-b447-be655588f15f tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:36.893514 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-c96442da-6460-4797-bc89-61a52c60242b tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:36.894127 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-c96442da-6460-4797-bc89-61a52c60242b tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] [instance: d7634742-9448-4848-a138-5f3f352eb832] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:36.897044 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-cd2368d3-2664-49b0-b447-be655588f15f tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903" status: 200 len: 1502 microversion: 2.1 time: 0.161173 Aug 31 19:15:36.897811 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 233/475] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:36 2022] GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903 => generated 1502 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:36.900099 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c96442da-6460-4797-bc89-61a52c60242b tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:36.900598 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c96442da-6460-4797-bc89-61a52c60242b tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:36.901056 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c96442da-6460-4797-bc89-61a52c60242b tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:36.901788 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c96442da-6460-4797-bc89-61a52c60242b tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:36.902244 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c96442da-6460-4797-bc89-61a52c60242b tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:36.902664 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c96442da-6460-4797-bc89-61a52c60242b tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:37.007305 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-2c9774bd-46b2-442f-ab76-833ead8c4a12 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:37.008203 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-2c9774bd-46b2-442f-ab76-833ead8c4a12 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:37.014392 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2c9774bd-46b2-442f-ab76-833ead8c4a12 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:37.015172 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2c9774bd-46b2-442f-ab76-833ead8c4a12 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:37.015820 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2c9774bd-46b2-442f-ab76-833ead8c4a12 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:37.016725 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2c9774bd-46b2-442f-ab76-833ead8c4a12 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:37.017275 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2c9774bd-46b2-442f-ab76-833ead8c4a12 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:37.017909 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2c9774bd-46b2-442f-ab76-833ead8c4a12 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:37.047422 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-c96442da-6460-4797-bc89-61a52c60242b tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426bb2c78bce40179a0a115651b81a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e4dacbe64a48f49f697787961e1200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:37.067001 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-c96442da-6460-4797-bc89-61a52c60242b tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] 10.222.0.65 "GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832" status: 200 len: 1314 microversion: 2.1 time: 0.177062 Aug 31 19:15:37.074042 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 243/476] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:36 2022] GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:15:37.105544 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-2c9774bd-46b2-442f-ab76-833ead8c4a12 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:37.108907 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-2c9774bd-46b2-442f-ab76-833ead8c4a12 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1137 microversion: 2.1 time: 0.105260 Aug 31 19:15:37.109508 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 234/477] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:37 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1137 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:37.444333 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-e40657ff-f682-4cbe-a256-549e25beb93e req-1735d2b6-ca78-4f66-a5d0-c33cec4dc7cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7634742-9448-4848-a138-5f3f352eb832", "name": "network-vif-plugged", "status": "completed", "tag": "12658f41-f52a-4a6e-9340-4674382141cf"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:15:37.457683 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-e40657ff-f682-4cbe-a256-549e25beb93e req-1735d2b6-ca78-4f66-a5d0-c33cec4dc7cc service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:37.458165 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-e40657ff-f682-4cbe-a256-549e25beb93e req-1735d2b6-ca78-4f66-a5d0-c33cec4dc7cc service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:37.458601 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-e40657ff-f682-4cbe-a256-549e25beb93e req-1735d2b6-ca78-4f66-a5d0-c33cec4dc7cc service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:37.471111 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-e40657ff-f682-4cbe-a256-549e25beb93e req-1735d2b6-ca78-4f66-a5d0-c33cec4dc7cc service nova] Creating event network-vif-plugged:12658f41-f52a-4a6e-9340-4674382141cf for instance d7634742-9448-4848-a138-5f3f352eb832 on hv-cinder-83538 Aug 31 19:15:37.476972 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-e40657ff-f682-4cbe-a256-549e25beb93e req-1735d2b6-ca78-4f66-a5d0-c33cec4dc7cc service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036268 Aug 31 19:15:37.479618 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 244/478] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:15:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:15:37.682962 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-b8fe6d1f-1058-4417-b16e-5b9e6ae7c2ac tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:37.683626 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-b8fe6d1f-1058-4417-b16e-5b9e6ae7c2ac tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:37.689488 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b8fe6d1f-1058-4417-b16e-5b9e6ae7c2ac tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:37.689966 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b8fe6d1f-1058-4417-b16e-5b9e6ae7c2ac tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:37.690393 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b8fe6d1f-1058-4417-b16e-5b9e6ae7c2ac tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:37.691074 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b8fe6d1f-1058-4417-b16e-5b9e6ae7c2ac tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:37.691520 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b8fe6d1f-1058-4417-b16e-5b9e6ae7c2ac tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:37.691934 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b8fe6d1f-1058-4417-b16e-5b9e6ae7c2ac tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:37.823477 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-b8fe6d1f-1058-4417-b16e-5b9e6ae7c2ac tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:37.831136 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-b8fe6d1f-1058-4417-b16e-5b9e6ae7c2ac tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48" status: 200 len: 1509 microversion: 2.1 time: 0.152185 Aug 31 19:15:37.831699 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 235/479] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:37 2022] GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:37.918455 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d8b2c2bd-5b0b-494f-a26f-8131d36af438 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:37.919154 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d8b2c2bd-5b0b-494f-a26f-8131d36af438 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 0582fb9e-35d5-48a2-852a-ddd8f3497903] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:37.921056 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:15:37.926577 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d8b2c2bd-5b0b-494f-a26f-8131d36af438 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:37.927056 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d8b2c2bd-5b0b-494f-a26f-8131d36af438 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:37.927490 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d8b2c2bd-5b0b-494f-a26f-8131d36af438 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:37.928164 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d8b2c2bd-5b0b-494f-a26f-8131d36af438 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:37.928612 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d8b2c2bd-5b0b-494f-a26f-8131d36af438 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:37.929030 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d8b2c2bd-5b0b-494f-a26f-8131d36af438 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:38.060060 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-d8b2c2bd-5b0b-494f-a26f-8131d36af438 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:38.067672 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-d8b2c2bd-5b0b-494f-a26f-8131d36af438 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903" status: 200 len: 1502 microversion: 2.1 time: 0.153452 Aug 31 19:15:38.068226 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 245/480] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:37 2022] GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903 => generated 1502 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:38.087666 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-a80d0fac-f1cc-4660-8648-855d055ce163 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:38.088306 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-a80d0fac-f1cc-4660-8648-855d055ce163 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] [instance: d7634742-9448-4848-a138-5f3f352eb832] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:38.094192 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a80d0fac-f1cc-4660-8648-855d055ce163 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:38.094676 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a80d0fac-f1cc-4660-8648-855d055ce163 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:38.095109 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a80d0fac-f1cc-4660-8648-855d055ce163 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:38.095790 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a80d0fac-f1cc-4660-8648-855d055ce163 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:38.096248 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a80d0fac-f1cc-4660-8648-855d055ce163 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:38.096672 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a80d0fac-f1cc-4660-8648-855d055ce163 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:38.146572 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-63238a27-7ac4-49d6-9620-aa69771fe84e tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:38.147188 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-63238a27-7ac4-49d6-9620-aa69771fe84e tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:38.157731 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-63238a27-7ac4-49d6-9620-aa69771fe84e tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:38.158230 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-63238a27-7ac4-49d6-9620-aa69771fe84e tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:38.158662 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-63238a27-7ac4-49d6-9620-aa69771fe84e tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:38.159368 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-63238a27-7ac4-49d6-9620-aa69771fe84e tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:38.159822 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-63238a27-7ac4-49d6-9620-aa69771fe84e tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:38.160244 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-63238a27-7ac4-49d6-9620-aa69771fe84e tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:38.276507 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-63238a27-7ac4-49d6-9620-aa69771fe84e tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:38.284475 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-63238a27-7ac4-49d6-9620-aa69771fe84e tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1129 microversion: 2.1 time: 0.150073 Aug 31 19:15:38.285399 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 246/481] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:38 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1129 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:38.324557 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-a80d0fac-f1cc-4660-8648-855d055ce163 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426bb2c78bce40179a0a115651b81a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e4dacbe64a48f49f697787961e1200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:38.337487 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-a80d0fac-f1cc-4660-8648-855d055ce163 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] 10.222.0.65 "GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832" status: 200 len: 1314 microversion: 2.1 time: 0.249846 Aug 31 19:15:38.338100 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 236/482] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:38 2022] GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832 => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:38.852330 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d8a89efe-c275-4d9b-ac7d-41423e9185f6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:38.853679 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d8a89efe-c275-4d9b-ac7d-41423e9185f6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:38.864720 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d8a89efe-c275-4d9b-ac7d-41423e9185f6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:38.865531 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d8a89efe-c275-4d9b-ac7d-41423e9185f6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:38.866208 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d8a89efe-c275-4d9b-ac7d-41423e9185f6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:38.868526 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d8a89efe-c275-4d9b-ac7d-41423e9185f6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:38.869882 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d8a89efe-c275-4d9b-ac7d-41423e9185f6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:38.870525 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d8a89efe-c275-4d9b-ac7d-41423e9185f6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:38.880772 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-f966471e-fcb0-49ec-b2d3-efee8a25bef5 req-1f15e903-faaa-47a0-830f-89ac1cfa3864 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0582fb9e-35d5-48a2-852a-ddd8f3497903", "name": "network-vif-deleted", "tag": "c92d1df8-d68d-459e-9b00-fbf7a3ed8436"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:15:38.892587 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-f966471e-fcb0-49ec-b2d3-efee8a25bef5 req-1f15e903-faaa-47a0-830f-89ac1cfa3864 service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:38.893054 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-f966471e-fcb0-49ec-b2d3-efee8a25bef5 req-1f15e903-faaa-47a0-830f-89ac1cfa3864 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:38.893514 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-f966471e-fcb0-49ec-b2d3-efee8a25bef5 req-1f15e903-faaa-47a0-830f-89ac1cfa3864 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:38.906519 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-f966471e-fcb0-49ec-b2d3-efee8a25bef5 req-1f15e903-faaa-47a0-830f-89ac1cfa3864 service nova] Creating event network-vif-deleted:c92d1df8-d68d-459e-9b00-fbf7a3ed8436 for instance 0582fb9e-35d5-48a2-852a-ddd8f3497903 on hv-cinder-83538 Aug 31 19:15:38.911853 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-f966471e-fcb0-49ec-b2d3-efee8a25bef5 req-1f15e903-faaa-47a0-830f-89ac1cfa3864 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034566 Aug 31 19:15:38.912650 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 237/483] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:15:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:15:39.026944 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-d8a89efe-c275-4d9b-ac7d-41423e9185f6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:39.034548 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-d8a89efe-c275-4d9b-ac7d-41423e9185f6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48" status: 200 len: 1509 microversion: 2.1 time: 0.186819 Aug 31 19:15:39.035146 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 247/484] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:38 2022] GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 => generated 1509 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:39.090143 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-539844b2-1fb8-4342-ac89-8feeba56a89f tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:39.090833 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-539844b2-1fb8-4342-ac89-8feeba56a89f tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 0582fb9e-35d5-48a2-852a-ddd8f3497903] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:39.096833 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-539844b2-1fb8-4342-ac89-8feeba56a89f tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:39.097347 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-539844b2-1fb8-4342-ac89-8feeba56a89f tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:39.097769 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-539844b2-1fb8-4342-ac89-8feeba56a89f tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:39.098442 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-539844b2-1fb8-4342-ac89-8feeba56a89f tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:39.098883 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-539844b2-1fb8-4342-ac89-8feeba56a89f tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:39.099293 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-539844b2-1fb8-4342-ac89-8feeba56a89f tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:39.163511 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-539844b2-1fb8-4342-ac89-8feeba56a89f tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:39.171465 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-539844b2-1fb8-4342-ac89-8feeba56a89f tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903" status: 200 len: 1460 microversion: 2.1 time: 0.086157 Aug 31 19:15:39.172053 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 238/485] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:39 2022] GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903 => generated 1460 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:39.307979 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-402e2c4a-3363-4348-9a1d-8c8eb13345aa tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:39.308768 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-402e2c4a-3363-4348-9a1d-8c8eb13345aa tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:39.314630 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-402e2c4a-3363-4348-9a1d-8c8eb13345aa tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:39.315109 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-402e2c4a-3363-4348-9a1d-8c8eb13345aa tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:39.315529 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-402e2c4a-3363-4348-9a1d-8c8eb13345aa tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:39.316204 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-402e2c4a-3363-4348-9a1d-8c8eb13345aa tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:39.316652 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-402e2c4a-3363-4348-9a1d-8c8eb13345aa tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:39.317063 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-402e2c4a-3363-4348-9a1d-8c8eb13345aa tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:39.361346 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-3865bf07-909e-4a20-8a28-43ee483c598b tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:39.362237 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-3865bf07-909e-4a20-8a28-43ee483c598b tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] [instance: d7634742-9448-4848-a138-5f3f352eb832] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:39.370944 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3865bf07-909e-4a20-8a28-43ee483c598b tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:39.371782 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3865bf07-909e-4a20-8a28-43ee483c598b tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:39.372385 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3865bf07-909e-4a20-8a28-43ee483c598b tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:39.373290 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3865bf07-909e-4a20-8a28-43ee483c598b tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:39.373894 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3865bf07-909e-4a20-8a28-43ee483c598b tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:39.374622 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3865bf07-909e-4a20-8a28-43ee483c598b tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:39.387676 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-402e2c4a-3363-4348-9a1d-8c8eb13345aa tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:39.399081 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-402e2c4a-3363-4348-9a1d-8c8eb13345aa tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1129 microversion: 2.1 time: 0.095241 Aug 31 19:15:39.401497 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 248/486] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:39 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1129 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:39.538318 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-3865bf07-909e-4a20-8a28-43ee483c598b tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426bb2c78bce40179a0a115651b81a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e4dacbe64a48f49f697787961e1200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:39.547441 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-3865bf07-909e-4a20-8a28-43ee483c598b tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] 10.222.0.65 "GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832" status: 200 len: 1314 microversion: 2.1 time: 0.192469 Aug 31 19:15:39.548320 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 239/487] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:39 2022] GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:40.057322 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-8e3200d9-51be-4eb5-b71d-bf4905ff854c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:40.058610 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-8e3200d9-51be-4eb5-b71d-bf4905ff854c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:40.064760 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8e3200d9-51be-4eb5-b71d-bf4905ff854c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:40.065536 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8e3200d9-51be-4eb5-b71d-bf4905ff854c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:40.066250 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8e3200d9-51be-4eb5-b71d-bf4905ff854c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:40.067185 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8e3200d9-51be-4eb5-b71d-bf4905ff854c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:40.067845 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8e3200d9-51be-4eb5-b71d-bf4905ff854c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:40.068444 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8e3200d9-51be-4eb5-b71d-bf4905ff854c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:40.192799 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-7d2b2480-5f46-40bb-9319-73b3e3e138c7 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:40.194054 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-7d2b2480-5f46-40bb-9319-73b3e3e138c7 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 0582fb9e-35d5-48a2-852a-ddd8f3497903] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:40.210641 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7d2b2480-5f46-40bb-9319-73b3e3e138c7 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:40.214298 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7d2b2480-5f46-40bb-9319-73b3e3e138c7 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:40.215000 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7d2b2480-5f46-40bb-9319-73b3e3e138c7 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:40.215936 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7d2b2480-5f46-40bb-9319-73b3e3e138c7 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:40.218187 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7d2b2480-5f46-40bb-9319-73b3e3e138c7 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:40.218894 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7d2b2480-5f46-40bb-9319-73b3e3e138c7 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:40.271342 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7d2b2480-5f46-40bb-9319-73b3e3e138c7 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:40.272169 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7d2b2480-5f46-40bb-9319-73b3e3e138c7 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:40.276910 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7d2b2480-5f46-40bb-9319-73b3e3e138c7 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:40.277656 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.objects.instance [None req-7d2b2480-5f46-40bb-9319-73b3e3e138c7 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lazy-loading 'fault' on Instance uuid 0582fb9e-35d5-48a2-852a-ddd8f3497903 {{(pid=120624) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:15:40.306035 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-8e3200d9-51be-4eb5-b71d-bf4905ff854c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:40.315145 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-8e3200d9-51be-4eb5-b71d-bf4905ff854c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48" status: 200 len: 1515 microversion: 2.1 time: 0.263331 Aug 31 19:15:40.315867 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 249/488] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:40 2022] GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 => generated 1515 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:40.340086 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-7d2b2480-5f46-40bb-9319-73b3e3e138c7 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:40.347864 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-7d2b2480-5f46-40bb-9319-73b3e3e138c7 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903" status: 200 len: 1303 microversion: 2.1 time: 0.159477 Aug 31 19:15:40.348441 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 240/489] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:40 2022] GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903 => generated 1303 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:40.420638 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-f4eaf49d-8401-4037-a68d-bd0ae2a1d818 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:40.421274 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-f4eaf49d-8401-4037-a68d-bd0ae2a1d818 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:40.427103 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f4eaf49d-8401-4037-a68d-bd0ae2a1d818 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:40.427936 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f4eaf49d-8401-4037-a68d-bd0ae2a1d818 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:40.428601 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f4eaf49d-8401-4037-a68d-bd0ae2a1d818 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:40.429313 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f4eaf49d-8401-4037-a68d-bd0ae2a1d818 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:40.429949 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f4eaf49d-8401-4037-a68d-bd0ae2a1d818 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:40.430533 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f4eaf49d-8401-4037-a68d-bd0ae2a1d818 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:40.449804 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=100 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:15:40.515015 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-f4eaf49d-8401-4037-a68d-bd0ae2a1d818 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:40.524825 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-f4eaf49d-8401-4037-a68d-bd0ae2a1d818 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1129 microversion: 2.1 time: 0.108614 Aug 31 19:15:40.526705 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 250/490] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:40 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1129 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:40.569501 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-8749c15f-1a90-4fe3-bebd-0ca556a089cd tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:40.570483 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-8749c15f-1a90-4fe3-bebd-0ca556a089cd tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] [instance: d7634742-9448-4848-a138-5f3f352eb832] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:40.579668 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8749c15f-1a90-4fe3-bebd-0ca556a089cd tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:40.580263 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8749c15f-1a90-4fe3-bebd-0ca556a089cd tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:40.580697 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8749c15f-1a90-4fe3-bebd-0ca556a089cd tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:40.581456 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8749c15f-1a90-4fe3-bebd-0ca556a089cd tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:40.581911 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8749c15f-1a90-4fe3-bebd-0ca556a089cd tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:40.582332 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8749c15f-1a90-4fe3-bebd-0ca556a089cd tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:40.760909 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-8749c15f-1a90-4fe3-bebd-0ca556a089cd tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426bb2c78bce40179a0a115651b81a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e4dacbe64a48f49f697787961e1200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:40.768692 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-8749c15f-1a90-4fe3-bebd-0ca556a089cd tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] 10.222.0.65 "GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832" status: 200 len: 1464 microversion: 2.1 time: 0.203297 Aug 31 19:15:40.769302 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 241/491] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:40 2022] GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832 => generated 1464 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:40.816285 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-800179bf-3c1b-439d-9545-1b0152c1f73e tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:40.816715 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-800179bf-3c1b-439d-9545-1b0152c1f73e tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] [instance: d7634742-9448-4848-a138-5f3f352eb832] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:40.824945 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-800179bf-3c1b-439d-9545-1b0152c1f73e tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:40.825457 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-800179bf-3c1b-439d-9545-1b0152c1f73e tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:40.825888 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-800179bf-3c1b-439d-9545-1b0152c1f73e tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:40.826573 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-800179bf-3c1b-439d-9545-1b0152c1f73e tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:40.827019 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-800179bf-3c1b-439d-9545-1b0152c1f73e tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:40.827432 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-800179bf-3c1b-439d-9545-1b0152c1f73e tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:40.853543 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-800179bf-3c1b-439d-9545-1b0152c1f73e tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] [instance: d7634742-9448-4848-a138-5f3f352eb832] Going to try to terminate instance {{(pid=120623) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 19:15:40.945456 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-800179bf-3c1b-439d-9545-1b0152c1f73e tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] 10.222.0.65 "DELETE /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832" status: 204 len: 0 microversion: 2.1 time: 0.132908 Aug 31 19:15:40.946325 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 251/492] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 31 19:15:40 2022] DELETE /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:15:40.954688 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-87c49dd9-f416-4516-9c13-2a69a935e93e tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:40.955332 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-87c49dd9-f416-4516-9c13-2a69a935e93e tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] [instance: d7634742-9448-4848-a138-5f3f352eb832] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:40.961926 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-87c49dd9-f416-4516-9c13-2a69a935e93e tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:40.962444 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-87c49dd9-f416-4516-9c13-2a69a935e93e tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:40.962876 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-87c49dd9-f416-4516-9c13-2a69a935e93e tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:40.964109 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-87c49dd9-f416-4516-9c13-2a69a935e93e tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:40.964563 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-87c49dd9-f416-4516-9c13-2a69a935e93e tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:40.964984 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-87c49dd9-f416-4516-9c13-2a69a935e93e tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:41.100000 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-87c49dd9-f416-4516-9c13-2a69a935e93e tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426bb2c78bce40179a0a115651b81a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e4dacbe64a48f49f697787961e1200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:41.108683 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-87c49dd9-f416-4516-9c13-2a69a935e93e tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] 10.222.0.65 "GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832" status: 200 len: 1470 microversion: 2.1 time: 0.158023 Aug 31 19:15:41.109262 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 242/493] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:40 2022] GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832 => generated 1470 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:15:41.393505 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-8b3498eb-987f-4ce1-bd7a-bb074a478e8f tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:41.394270 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-8b3498eb-987f-4ce1-bd7a-bb074a478e8f tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 0582fb9e-35d5-48a2-852a-ddd8f3497903] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:41.406194 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell0:SELECT=2 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:15:41.407403 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell0:SELECT=6 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:15:41.418097 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8b3498eb-987f-4ce1-bd7a-bb074a478e8f tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:41.419642 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8b3498eb-987f-4ce1-bd7a-bb074a478e8f tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:41.421021 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8b3498eb-987f-4ce1-bd7a-bb074a478e8f tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:41.422416 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8b3498eb-987f-4ce1-bd7a-bb074a478e8f tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:41.423807 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8b3498eb-987f-4ce1-bd7a-bb074a478e8f tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:41.424649 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8b3498eb-987f-4ce1-bd7a-bb074a478e8f tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:41.476593 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8b3498eb-987f-4ce1-bd7a-bb074a478e8f tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:41.477087 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8b3498eb-987f-4ce1-bd7a-bb074a478e8f tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:41.477931 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8b3498eb-987f-4ce1-bd7a-bb074a478e8f tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:41.478668 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.objects.instance [None req-8b3498eb-987f-4ce1-bd7a-bb074a478e8f tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lazy-loading 'fault' on Instance uuid 0582fb9e-35d5-48a2-852a-ddd8f3497903 {{(pid=120623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:15:41.528019 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-8b3498eb-987f-4ce1-bd7a-bb074a478e8f tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:41.535667 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-8b3498eb-987f-4ce1-bd7a-bb074a478e8f tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903" status: 200 len: 1303 microversion: 2.1 time: 0.168979 Aug 31 19:15:41.536492 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 252/494] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:41 2022] GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903 => generated 1303 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:41.549464 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-5ca182f0-82bf-4d87-90ec-bd1681b6d814 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:41.550075 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-5ca182f0-82bf-4d87-90ec-bd1681b6d814 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:41.556369 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5ca182f0-82bf-4d87-90ec-bd1681b6d814 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:41.556770 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5ca182f0-82bf-4d87-90ec-bd1681b6d814 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:41.557761 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5ca182f0-82bf-4d87-90ec-bd1681b6d814 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:41.558573 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5ca182f0-82bf-4d87-90ec-bd1681b6d814 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:41.559172 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5ca182f0-82bf-4d87-90ec-bd1681b6d814 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:41.559634 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5ca182f0-82bf-4d87-90ec-bd1681b6d814 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:41.564389 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell0:SELECT=2 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:15:41.642053 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-5ca182f0-82bf-4d87-90ec-bd1681b6d814 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:41.650361 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-5ca182f0-82bf-4d87-90ec-bd1681b6d814 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1185 microversion: 2.1 time: 0.108169 Aug 31 19:15:41.650938 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 243/495] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:41 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:42.130174 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-1ff09bbb-769e-4065-b8a6-76cf24a79ff2 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:42.131125 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-1ff09bbb-769e-4065-b8a6-76cf24a79ff2 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] [instance: d7634742-9448-4848-a138-5f3f352eb832] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:42.137267 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1ff09bbb-769e-4065-b8a6-76cf24a79ff2 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:42.137863 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1ff09bbb-769e-4065-b8a6-76cf24a79ff2 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:42.138365 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1ff09bbb-769e-4065-b8a6-76cf24a79ff2 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:42.139342 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1ff09bbb-769e-4065-b8a6-76cf24a79ff2 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:42.139830 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1ff09bbb-769e-4065-b8a6-76cf24a79ff2 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:42.140335 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1ff09bbb-769e-4065-b8a6-76cf24a79ff2 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:42.321590 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1ff09bbb-769e-4065-b8a6-76cf24a79ff2 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426bb2c78bce40179a0a115651b81a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e4dacbe64a48f49f697787961e1200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:42.333240 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-1ff09bbb-769e-4065-b8a6-76cf24a79ff2 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] 10.222.0.65 "GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832" status: 200 len: 1470 microversion: 2.1 time: 0.207098 Aug 31 19:15:42.333357 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 253/496] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:42 2022] GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832 => generated 1470 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:42.556973 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-8ede10ad-3186-4784-9017-1487148f8372 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:42.558400 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-8ede10ad-3186-4784-9017-1487148f8372 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 0582fb9e-35d5-48a2-852a-ddd8f3497903] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:42.565347 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8ede10ad-3186-4784-9017-1487148f8372 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:42.565880 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8ede10ad-3186-4784-9017-1487148f8372 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:42.566498 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8ede10ad-3186-4784-9017-1487148f8372 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:42.567196 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8ede10ad-3186-4784-9017-1487148f8372 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:42.567642 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8ede10ad-3186-4784-9017-1487148f8372 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:42.568058 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8ede10ad-3186-4784-9017-1487148f8372 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:42.601676 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8ede10ad-3186-4784-9017-1487148f8372 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:42.602291 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8ede10ad-3186-4784-9017-1487148f8372 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:42.602725 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8ede10ad-3186-4784-9017-1487148f8372 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:42.603164 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.objects.instance [None req-8ede10ad-3186-4784-9017-1487148f8372 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lazy-loading 'fault' on Instance uuid 0582fb9e-35d5-48a2-852a-ddd8f3497903 {{(pid=120624) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:15:42.649166 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-8ede10ad-3186-4784-9017-1487148f8372 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:42.654577 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=100 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:15:42.660772 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-8ede10ad-3186-4784-9017-1487148f8372 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903" status: 200 len: 1303 microversion: 2.1 time: 0.108707 Aug 31 19:15:42.661397 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 244/497] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:42 2022] GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903 => generated 1303 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:42.671520 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-87dba5ee-f1cd-43da-b24d-3a6230e10d9f tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:42.672734 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-87dba5ee-f1cd-43da-b24d-3a6230e10d9f tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:42.678735 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-87dba5ee-f1cd-43da-b24d-3a6230e10d9f tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:42.679481 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-87dba5ee-f1cd-43da-b24d-3a6230e10d9f tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:42.679915 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-87dba5ee-f1cd-43da-b24d-3a6230e10d9f tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:42.680595 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-87dba5ee-f1cd-43da-b24d-3a6230e10d9f tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:42.681631 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-87dba5ee-f1cd-43da-b24d-3a6230e10d9f tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:42.682144 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-87dba5ee-f1cd-43da-b24d-3a6230e10d9f tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:42.755204 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-87dba5ee-f1cd-43da-b24d-3a6230e10d9f tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:42.766996 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-87dba5ee-f1cd-43da-b24d-3a6230e10d9f tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1185 microversion: 2.1 time: 0.099592 Aug 31 19:15:42.767553 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 254/498] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:42 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:42.788942 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-443ccf67-32bc-421c-b24c-40a17e35519d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Action: 'create', calling method: .version_select at 0x7fdb8652a3a0>, body: {"keypair": {"name": "tempest-keypair-1130831647", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYZScGjsBSxXx4eO1abmVbl2FUt34fV5imoONUQME/+eflhwytqC27SLTblRJLMYrkUK+xgekRmKy6CjbF8jhPem42xxvYblSvbAGPLAvRUJv7Dw/WQEOdCVKdB+MYCQA=="}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:15:42.805988 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-443ccf67-32bc-421c-b24c-40a17e35519d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Getting quotas for project e3aa913bb25c45039643ce87bb84cbc2. Resources: {'key_pairs'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:15:42.813063 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-443ccf67-32bc-421c-b24c-40a17e35519d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Getting quotas for user aa81a686e4324370a20e3fc35e5cc7a5 and project e3aa913bb25c45039643ce87bb84cbc2. Resources: {'key_pairs'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:15:42.843782 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-443ccf67-32bc-421c-b24c-40a17e35519d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.058747 Aug 31 19:15:42.844366 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 245/499] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Aug 31 19:15:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:15:43.353880 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-4e5b8d98-d977-4e4a-ac0a-701190c64675 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:43.354514 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-4e5b8d98-d977-4e4a-ac0a-701190c64675 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] [instance: d7634742-9448-4848-a138-5f3f352eb832] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:43.360647 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4e5b8d98-d977-4e4a-ac0a-701190c64675 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:43.361132 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4e5b8d98-d977-4e4a-ac0a-701190c64675 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:43.361644 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4e5b8d98-d977-4e4a-ac0a-701190c64675 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:43.362709 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4e5b8d98-d977-4e4a-ac0a-701190c64675 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:43.363373 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4e5b8d98-d977-4e4a-ac0a-701190c64675 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:43.363866 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4e5b8d98-d977-4e4a-ac0a-701190c64675 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:43.671245 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-4e5b8d98-d977-4e4a-ac0a-701190c64675 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426bb2c78bce40179a0a115651b81a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e4dacbe64a48f49f697787961e1200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:43.676032 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-7609b4a6-8146-4414-a247-dadde70b65c7 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-311699798", "imageRef": "f4f2ae76-bacc-4449-881b-f697e1eeec66", "flavorRef": "452", "networks": [{"uuid": "0d30bf9a-bd0d-4b7f-ab18-0782e567548f"}]}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:15:43.687721 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-4e5b8d98-d977-4e4a-ac0a-701190c64675 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] 10.222.0.65 "GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832" status: 200 len: 1470 microversion: 2.1 time: 0.336943 Aug 31 19:15:43.689286 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 255/500] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:43 2022] GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832 => generated 1470 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:15:43.694977 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-c6d0f80c-ff50-49ed-8c50-d2d43e809962 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:43.695867 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-c6d0f80c-ff50-49ed-8c50-d2d43e809962 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 0582fb9e-35d5-48a2-852a-ddd8f3497903] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:43.702659 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c6d0f80c-ff50-49ed-8c50-d2d43e809962 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:43.703838 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c6d0f80c-ff50-49ed-8c50-d2d43e809962 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:43.704596 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c6d0f80c-ff50-49ed-8c50-d2d43e809962 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:43.705557 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c6d0f80c-ff50-49ed-8c50-d2d43e809962 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:43.706425 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c6d0f80c-ff50-49ed-8c50-d2d43e809962 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:43.707150 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c6d0f80c-ff50-49ed-8c50-d2d43e809962 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:43.745692 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c6d0f80c-ff50-49ed-8c50-d2d43e809962 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:43.746553 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c6d0f80c-ff50-49ed-8c50-d2d43e809962 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:43.747201 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c6d0f80c-ff50-49ed-8c50-d2d43e809962 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:43.748190 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.objects.instance [None req-c6d0f80c-ff50-49ed-8c50-d2d43e809962 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lazy-loading 'fault' on Instance uuid 0582fb9e-35d5-48a2-852a-ddd8f3497903 {{(pid=120623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:15:43.766643 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.network.neutron [None req-7609b4a6-8146-4414-a247-dadde70b65c7 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] validate_networks() for [('0d30bf9a-bd0d-4b7f-ab18-0782e567548f', None, None, None, None, None)] {{(pid=120624) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:15:43.817777 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-c6d0f80c-ff50-49ed-8c50-d2d43e809962 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:43.826344 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-c6d0f80c-ff50-49ed-8c50-d2d43e809962 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903" status: 200 len: 1303 microversion: 2.1 time: 0.135326 Aug 31 19:15:43.827084 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 256/501] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:43 2022] GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903 => generated 1303 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:43.835734 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-54e91dc7-70c2-410b-9ac7-0b34577d1982 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:43.836331 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-54e91dc7-70c2-410b-9ac7-0b34577d1982 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:43.843042 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-54e91dc7-70c2-410b-9ac7-0b34577d1982 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:43.843623 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-54e91dc7-70c2-410b-9ac7-0b34577d1982 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:43.843946 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-54e91dc7-70c2-410b-9ac7-0b34577d1982 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:43.844636 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-54e91dc7-70c2-410b-9ac7-0b34577d1982 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:43.845079 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-54e91dc7-70c2-410b-9ac7-0b34577d1982 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:43.845530 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-54e91dc7-70c2-410b-9ac7-0b34577d1982 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:43.917824 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-54e91dc7-70c2-410b-9ac7-0b34577d1982 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:43.928481 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-54e91dc7-70c2-410b-9ac7-0b34577d1982 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1193 microversion: 2.1 time: 0.100163 Aug 31 19:15:43.929045 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 257/502] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:43 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1193 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:44.098175 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-0d149814-2127-4bfd-b258-1bee7d5afab9 req-0a590aa2-96f9-4421-965a-cda2281566e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7634742-9448-4848-a138-5f3f352eb832", "name": "network-vif-deleted", "tag": "12658f41-f52a-4a6e-9340-4674382141cf"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:15:44.117968 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-0d149814-2127-4bfd-b258-1bee7d5afab9 req-0a590aa2-96f9-4421-965a-cda2281566e9 service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:44.118879 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-0d149814-2127-4bfd-b258-1bee7d5afab9 req-0a590aa2-96f9-4421-965a-cda2281566e9 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:44.119636 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-0d149814-2127-4bfd-b258-1bee7d5afab9 req-0a590aa2-96f9-4421-965a-cda2281566e9 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:44.132864 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-0d149814-2127-4bfd-b258-1bee7d5afab9 req-0a590aa2-96f9-4421-965a-cda2281566e9 service nova] Creating event network-vif-deleted:12658f41-f52a-4a6e-9340-4674382141cf for instance d7634742-9448-4848-a138-5f3f352eb832 on hv-cinder-83538 Aug 31 19:15:44.140205 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-0d149814-2127-4bfd-b258-1bee7d5afab9 req-0a590aa2-96f9-4421-965a-cda2281566e9 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045724 Aug 31 19:15:44.141030 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 258/503] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:15:44.377081 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-7609b4a6-8146-4414-a247-dadde70b65c7 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Flavor limits 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:15:44.377517 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-7609b4a6-8146-4414-a247-dadde70b65c7 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Image limits 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:15:44.377979 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-7609b4a6-8146-4414-a247-dadde70b65c7 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Flavor pref 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:15:44.378374 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-7609b4a6-8146-4414-a247-dadde70b65c7 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Image pref 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:15:44.378773 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-7609b4a6-8146-4414-a247-dadde70b65c7 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:15:44.388457 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7609b4a6-8146-4414-a247-dadde70b65c7 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:44.388934 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7609b4a6-8146-4414-a247-dadde70b65c7 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:44.389386 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7609b4a6-8146-4414-a247-dadde70b65c7 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:44.390094 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7609b4a6-8146-4414-a247-dadde70b65c7 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:44.390539 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7609b4a6-8146-4414-a247-dadde70b65c7 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:44.390949 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7609b4a6-8146-4414-a247-dadde70b65c7 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:44.408209 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-7609b4a6-8146-4414-a247-dadde70b65c7 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Getting quotas for project 08d5f61674804f93bd2127fc76919bd3. Resources: {'instances', 'cores', 'ram'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:15:44.412107 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-7609b4a6-8146-4414-a247-dadde70b65c7 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Getting quotas for user b1b8da543ad543bb95881450e4f9b585 and project 08d5f61674804f93bd2127fc76919bd3. Resources: {'instances', 'cores', 'ram'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:15:44.421846 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:15:44.424746 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-7609b4a6-8146-4414-a247-dadde70b65c7 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Going to run 1 instances... {{(pid=120624) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:15:44.427074 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-7609b4a6-8146-4414-a247-dadde70b65c7 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: 99d78918-36ca-462d-9037-ea8b81fbfc2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f4f2ae76-bacc-4449-881b-f697e1eeec66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120624) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:15:44.473357 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-7609b4a6-8146-4414-a247-dadde70b65c7 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.801605 Aug 31 19:15:44.480842 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 246/504] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 31 19:15:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 810 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 19:15:44.487367 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-adea33b9-2fa3-4184-91fb-78c2eecd0bb2 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:44.487861 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-adea33b9-2fa3-4184-91fb-78c2eecd0bb2 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: 99d78918-36ca-462d-9037-ea8b81fbfc2e] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:44.546552 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-adea33b9-2fa3-4184-91fb-78c2eecd0bb2 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b8da543ad543bb95881450e4f9b585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5f61674804f93bd2127fc76919bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:44.555689 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-adea33b9-2fa3-4184-91fb-78c2eecd0bb2 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] 10.222.0.65 "GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e" status: 200 len: 1218 microversion: 2.1 time: 0.073764 Aug 31 19:15:44.556261 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 259/505] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:44 2022] GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e => generated 1218 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:44.715392 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-1dcd272c-dacd-4216-b3ea-b6eba79c1f82 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:44.716627 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-1dcd272c-dacd-4216-b3ea-b6eba79c1f82 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] [instance: d7634742-9448-4848-a138-5f3f352eb832] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:44.721442 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d5ddf4ab-be68-4a86-ad95-70d21c0a0b0e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1895471822", "imageRef": "f4f2ae76-bacc-4449-881b-f697e1eeec66", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5665d234-ccc2-49d8-a927-e4f4c8c9591b"}], "security_groups": [{"name": "tempest-securitygroup--1852507230"}], "key_name": "tempest-keypair-1130831647", "user_data": "}} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:15:44.723616 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1dcd272c-dacd-4216-b3ea-b6eba79c1f82 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:44.724089 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1dcd272c-dacd-4216-b3ea-b6eba79c1f82 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:44.724647 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1dcd272c-dacd-4216-b3ea-b6eba79c1f82 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:44.725529 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1dcd272c-dacd-4216-b3ea-b6eba79c1f82 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:44.725854 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1dcd272c-dacd-4216-b3ea-b6eba79c1f82 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:44.726318 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1dcd272c-dacd-4216-b3ea-b6eba79c1f82 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:44.763338 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1dcd272c-dacd-4216-b3ea-b6eba79c1f82 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:44.763807 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1dcd272c-dacd-4216-b3ea-b6eba79c1f82 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:44.764412 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1dcd272c-dacd-4216-b3ea-b6eba79c1f82 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:44.764895 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.objects.instance [None req-1dcd272c-dacd-4216-b3ea-b6eba79c1f82 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lazy-loading 'fault' on Instance uuid d7634742-9448-4848-a138-5f3f352eb832 {{(pid=120624) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:15:44.813116 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-1dcd272c-dacd-4216-b3ea-b6eba79c1f82 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426bb2c78bce40179a0a115651b81a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e4dacbe64a48f49f697787961e1200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:44.820868 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-1dcd272c-dacd-4216-b3ea-b6eba79c1f82 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] 10.222.0.65 "GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832" status: 200 len: 1304 microversion: 2.1 time: 0.110802 Aug 31 19:15:44.821464 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 247/506] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:44 2022] GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832 => generated 1304 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:44.837221 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.network.neutron [None req-d5ddf4ab-be68-4a86-ad95-70d21c0a0b0e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] validate_networks() for [('5665d234-ccc2-49d8-a927-e4f4c8c9591b', None, None, None, None, None)] {{(pid=120623) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:15:44.847612 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-378144e5-04f3-4fb7-8605-d5f712e1012d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:44.848419 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-378144e5-04f3-4fb7-8605-d5f712e1012d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 0582fb9e-35d5-48a2-852a-ddd8f3497903] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:44.856283 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-378144e5-04f3-4fb7-8605-d5f712e1012d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:44.856761 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-378144e5-04f3-4fb7-8605-d5f712e1012d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:44.857384 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-378144e5-04f3-4fb7-8605-d5f712e1012d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:44.858073 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-378144e5-04f3-4fb7-8605-d5f712e1012d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:44.858513 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-378144e5-04f3-4fb7-8605-d5f712e1012d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:44.858923 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-378144e5-04f3-4fb7-8605-d5f712e1012d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:44.891916 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-378144e5-04f3-4fb7-8605-d5f712e1012d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:44.892402 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-378144e5-04f3-4fb7-8605-d5f712e1012d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:44.892872 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-378144e5-04f3-4fb7-8605-d5f712e1012d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:44.893297 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.objects.instance [None req-378144e5-04f3-4fb7-8605-d5f712e1012d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lazy-loading 'fault' on Instance uuid 0582fb9e-35d5-48a2-852a-ddd8f3497903 {{(pid=120624) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:15:44.935457 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-378144e5-04f3-4fb7-8605-d5f712e1012d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:44.942979 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-378144e5-04f3-4fb7-8605-d5f712e1012d tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903" status: 200 len: 1303 microversion: 2.1 time: 0.099192 Aug 31 19:15:44.943539 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 248/507] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:44 2022] GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903 => generated 1303 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:15:44.950302 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-997453bd-5e3e-4155-8ff4-07126d7006eb tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:44.950997 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-997453bd-5e3e-4155-8ff4-07126d7006eb tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:44.956768 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-997453bd-5e3e-4155-8ff4-07126d7006eb tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:44.957364 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-997453bd-5e3e-4155-8ff4-07126d7006eb tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:44.957864 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-997453bd-5e3e-4155-8ff4-07126d7006eb tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:44.958618 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-997453bd-5e3e-4155-8ff4-07126d7006eb tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:44.959136 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-997453bd-5e3e-4155-8ff4-07126d7006eb tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:44.959618 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-997453bd-5e3e-4155-8ff4-07126d7006eb tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:45.024785 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-997453bd-5e3e-4155-8ff4-07126d7006eb tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:45.033264 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-997453bd-5e3e-4155-8ff4-07126d7006eb tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1203 microversion: 2.1 time: 0.086919 Aug 31 19:15:45.033836 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 249/508] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:44 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1203 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:45.227604 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-d5ddf4ab-be68-4a86-ad95-70d21c0a0b0e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Flavor limits 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:15:45.228027 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-d5ddf4ab-be68-4a86-ad95-70d21c0a0b0e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Image limits 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:15:45.228500 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-d5ddf4ab-be68-4a86-ad95-70d21c0a0b0e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Flavor pref 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:15:45.228957 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-d5ddf4ab-be68-4a86-ad95-70d21c0a0b0e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Image pref 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:15:45.229400 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-d5ddf4ab-be68-4a86-ad95-70d21c0a0b0e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:15:45.238546 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d5ddf4ab-be68-4a86-ad95-70d21c0a0b0e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:45.239030 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d5ddf4ab-be68-4a86-ad95-70d21c0a0b0e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:45.239461 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d5ddf4ab-be68-4a86-ad95-70d21c0a0b0e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:45.240184 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d5ddf4ab-be68-4a86-ad95-70d21c0a0b0e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:45.240637 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d5ddf4ab-be68-4a86-ad95-70d21c0a0b0e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:45.241058 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d5ddf4ab-be68-4a86-ad95-70d21c0a0b0e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:45.257824 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.quota [None req-d5ddf4ab-be68-4a86-ad95-70d21c0a0b0e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Getting quotas for project e3aa913bb25c45039643ce87bb84cbc2. Resources: {'instances', 'cores', 'ram'} {{(pid=120623) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:15:45.264138 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.quota [None req-d5ddf4ab-be68-4a86-ad95-70d21c0a0b0e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Getting quotas for user aa81a686e4324370a20e3fc35e5cc7a5 and project e3aa913bb25c45039643ce87bb84cbc2. Resources: {'instances', 'cores', 'ram'} {{(pid=120623) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:15:45.279112 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d5ddf4ab-be68-4a86-ad95-70d21c0a0b0e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Going to run 1 instances... {{(pid=120623) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:15:45.281541 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d5ddf4ab-be68-4a86-ad95-70d21c0a0b0e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f4f2ae76-bacc-4449-881b-f697e1eeec66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120623) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:15:45.328768 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-d5ddf4ab-be68-4a86-ad95-70d21c0a0b0e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.613426 Aug 31 19:15:45.329431 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 260/509] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 31 19:15:44 2022] POST /compute/v2.1/servers => generated 409 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 19:15:45.340273 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-aac4c56f-dc82-454c-92a7-fa76cbb6d2c7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:45.340991 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-aac4c56f-dc82-454c-92a7-fa76cbb6d2c7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:45.394953 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-aac4c56f-dc82-454c-92a7-fa76cbb6d2c7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:45.401955 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-aac4c56f-dc82-454c-92a7-fa76cbb6d2c7 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1246 microversion: 2.1 time: 0.065538 Aug 31 19:15:45.402522 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 250/510] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:45 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1246 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:45.577155 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-8326b303-045f-4523-a4fb-a2ae1c26a7b7 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:45.577867 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-8326b303-045f-4523-a4fb-a2ae1c26a7b7 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: 99d78918-36ca-462d-9037-ea8b81fbfc2e] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:45.584773 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8326b303-045f-4523-a4fb-a2ae1c26a7b7 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:45.585283 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8326b303-045f-4523-a4fb-a2ae1c26a7b7 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:45.585735 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8326b303-045f-4523-a4fb-a2ae1c26a7b7 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:45.586406 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8326b303-045f-4523-a4fb-a2ae1c26a7b7 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:45.586859 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8326b303-045f-4523-a4fb-a2ae1c26a7b7 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:45.587280 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8326b303-045f-4523-a4fb-a2ae1c26a7b7 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:45.662755 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-8326b303-045f-4523-a4fb-a2ae1c26a7b7 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b8da543ad543bb95881450e4f9b585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5f61674804f93bd2127fc76919bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:45.672942 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-8326b303-045f-4523-a4fb-a2ae1c26a7b7 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] 10.222.0.65 "GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e" status: 200 len: 1222 microversion: 2.1 time: 0.100105 Aug 31 19:15:45.673559 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 261/511] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:45 2022] GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e => generated 1222 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:15:45.841706 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-c8de01bb-2af0-4a83-91ac-0dd74a73542e tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:45.842308 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-c8de01bb-2af0-4a83-91ac-0dd74a73542e tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] [instance: d7634742-9448-4848-a138-5f3f352eb832] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:45.849509 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c8de01bb-2af0-4a83-91ac-0dd74a73542e tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:45.849988 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c8de01bb-2af0-4a83-91ac-0dd74a73542e tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:45.850422 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c8de01bb-2af0-4a83-91ac-0dd74a73542e tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:45.851098 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c8de01bb-2af0-4a83-91ac-0dd74a73542e tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:45.851545 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c8de01bb-2af0-4a83-91ac-0dd74a73542e tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:45.851959 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c8de01bb-2af0-4a83-91ac-0dd74a73542e tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:45.882588 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c8de01bb-2af0-4a83-91ac-0dd74a73542e tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:45.883064 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c8de01bb-2af0-4a83-91ac-0dd74a73542e tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:45.883489 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c8de01bb-2af0-4a83-91ac-0dd74a73542e tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:45.883924 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.objects.instance [None req-c8de01bb-2af0-4a83-91ac-0dd74a73542e tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lazy-loading 'fault' on Instance uuid d7634742-9448-4848-a138-5f3f352eb832 {{(pid=120624) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:15:45.924561 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-c8de01bb-2af0-4a83-91ac-0dd74a73542e tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426bb2c78bce40179a0a115651b81a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e4dacbe64a48f49f697787961e1200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:45.932856 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-c8de01bb-2af0-4a83-91ac-0dd74a73542e tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] 10.222.0.65 "GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832" status: 200 len: 1304 microversion: 2.1 time: 0.094377 Aug 31 19:15:45.933439 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 251/512] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:45 2022] GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832 => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:45.964854 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-3b2400db-3b3a-41b0-a2db-dd50fa2273e1 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:45.965438 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-3b2400db-3b3a-41b0-a2db-dd50fa2273e1 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 0582fb9e-35d5-48a2-852a-ddd8f3497903] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:45.971370 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3b2400db-3b3a-41b0-a2db-dd50fa2273e1 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:45.971857 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3b2400db-3b3a-41b0-a2db-dd50fa2273e1 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:45.972293 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3b2400db-3b3a-41b0-a2db-dd50fa2273e1 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:45.972975 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3b2400db-3b3a-41b0-a2db-dd50fa2273e1 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:45.973457 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3b2400db-3b3a-41b0-a2db-dd50fa2273e1 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:45.973882 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3b2400db-3b3a-41b0-a2db-dd50fa2273e1 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:46.004877 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3b2400db-3b3a-41b0-a2db-dd50fa2273e1 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:46.005385 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3b2400db-3b3a-41b0-a2db-dd50fa2273e1 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:46.005814 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3b2400db-3b3a-41b0-a2db-dd50fa2273e1 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:46.006248 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.objects.instance [None req-3b2400db-3b3a-41b0-a2db-dd50fa2273e1 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lazy-loading 'fault' on Instance uuid 0582fb9e-35d5-48a2-852a-ddd8f3497903 {{(pid=120623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:15:46.049483 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-3b2400db-3b3a-41b0-a2db-dd50fa2273e1 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:46.054031 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-23b571b4-bcc5-4276-9e51-933f2042b256 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:46.054636 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-23b571b4-bcc5-4276-9e51-933f2042b256 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:46.057089 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-3b2400db-3b3a-41b0-a2db-dd50fa2273e1 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903" status: 200 len: 1303 microversion: 2.1 time: 0.096086 Aug 31 19:15:46.057682 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 262/513] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:45 2022] GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903 => generated 1303 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:46.060458 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-23b571b4-bcc5-4276-9e51-933f2042b256 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:46.060939 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-23b571b4-bcc5-4276-9e51-933f2042b256 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:46.061402 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-23b571b4-bcc5-4276-9e51-933f2042b256 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:46.062087 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-23b571b4-bcc5-4276-9e51-933f2042b256 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:46.062532 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-23b571b4-bcc5-4276-9e51-933f2042b256 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:46.062948 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-23b571b4-bcc5-4276-9e51-933f2042b256 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:46.123462 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-23b571b4-bcc5-4276-9e51-933f2042b256 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:46.130828 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-23b571b4-bcc5-4276-9e51-933f2042b256 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1203 microversion: 2.1 time: 0.080599 Aug 31 19:15:46.131383 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 252/514] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:46 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1203 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:15:46.422510 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-ff5a3923-8062-4c11-ad49-9b946d2e53f8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:46.423119 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-ff5a3923-8062-4c11-ad49-9b946d2e53f8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:46.429138 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ff5a3923-8062-4c11-ad49-9b946d2e53f8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:46.429649 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ff5a3923-8062-4c11-ad49-9b946d2e53f8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:46.430077 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ff5a3923-8062-4c11-ad49-9b946d2e53f8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:46.430758 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ff5a3923-8062-4c11-ad49-9b946d2e53f8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:46.431212 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ff5a3923-8062-4c11-ad49-9b946d2e53f8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:46.431631 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ff5a3923-8062-4c11-ad49-9b946d2e53f8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:46.491788 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-ff5a3923-8062-4c11-ad49-9b946d2e53f8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:46.499440 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-ff5a3923-8062-4c11-ad49-9b946d2e53f8 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1250 microversion: 2.1 time: 0.080739 Aug 31 19:15:46.499998 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 263/515] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:46 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1250 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:46.695402 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-1b186fb5-1425-4c00-a19a-401871456bad tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:46.696004 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-1b186fb5-1425-4c00-a19a-401871456bad tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: 99d78918-36ca-462d-9037-ea8b81fbfc2e] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:46.702583 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1b186fb5-1425-4c00-a19a-401871456bad tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:46.703063 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1b186fb5-1425-4c00-a19a-401871456bad tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:46.703491 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1b186fb5-1425-4c00-a19a-401871456bad tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:46.704175 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1b186fb5-1425-4c00-a19a-401871456bad tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:46.704630 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1b186fb5-1425-4c00-a19a-401871456bad tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:46.705047 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1b186fb5-1425-4c00-a19a-401871456bad tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:46.765824 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-1b186fb5-1425-4c00-a19a-401871456bad tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b8da543ad543bb95881450e4f9b585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5f61674804f93bd2127fc76919bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:46.773943 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-1b186fb5-1425-4c00-a19a-401871456bad tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] 10.222.0.65 "GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e" status: 200 len: 1222 microversion: 2.1 time: 0.082597 Aug 31 19:15:46.774614 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 253/516] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:46 2022] GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:46.953502 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-eeb9ca68-0313-4708-96a4-f32466bafee9 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:46.954460 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-eeb9ca68-0313-4708-96a4-f32466bafee9 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] [instance: d7634742-9448-4848-a138-5f3f352eb832] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:46.964011 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-eeb9ca68-0313-4708-96a4-f32466bafee9 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:46.964875 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-eeb9ca68-0313-4708-96a4-f32466bafee9 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:46.965683 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-eeb9ca68-0313-4708-96a4-f32466bafee9 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:46.966914 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-eeb9ca68-0313-4708-96a4-f32466bafee9 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:46.967517 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-eeb9ca68-0313-4708-96a4-f32466bafee9 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:46.968190 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-eeb9ca68-0313-4708-96a4-f32466bafee9 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:46.999265 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-eeb9ca68-0313-4708-96a4-f32466bafee9 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:46.999739 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-eeb9ca68-0313-4708-96a4-f32466bafee9 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:47.000169 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-eeb9ca68-0313-4708-96a4-f32466bafee9 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:47.000606 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.objects.instance [None req-eeb9ca68-0313-4708-96a4-f32466bafee9 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lazy-loading 'fault' on Instance uuid d7634742-9448-4848-a138-5f3f352eb832 {{(pid=120623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:15:47.039840 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-eeb9ca68-0313-4708-96a4-f32466bafee9 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426bb2c78bce40179a0a115651b81a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e4dacbe64a48f49f697787961e1200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:47.047359 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-eeb9ca68-0313-4708-96a4-f32466bafee9 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] 10.222.0.65 "GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832" status: 200 len: 1304 microversion: 2.1 time: 0.097827 Aug 31 19:15:47.047913 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 264/517] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:46 2022] GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832 => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:47.077910 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-ad1c772a-6036-40cc-be43-08a4c48391b8 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:47.078519 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-ad1c772a-6036-40cc-be43-08a4c48391b8 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 0582fb9e-35d5-48a2-852a-ddd8f3497903] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:47.084460 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ad1c772a-6036-40cc-be43-08a4c48391b8 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:47.084940 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ad1c772a-6036-40cc-be43-08a4c48391b8 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:47.085407 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ad1c772a-6036-40cc-be43-08a4c48391b8 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:47.086095 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ad1c772a-6036-40cc-be43-08a4c48391b8 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:47.086544 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ad1c772a-6036-40cc-be43-08a4c48391b8 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:47.086963 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ad1c772a-6036-40cc-be43-08a4c48391b8 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:47.116639 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ad1c772a-6036-40cc-be43-08a4c48391b8 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:47.117112 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ad1c772a-6036-40cc-be43-08a4c48391b8 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:47.117571 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ad1c772a-6036-40cc-be43-08a4c48391b8 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:47.118009 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.objects.instance [None req-ad1c772a-6036-40cc-be43-08a4c48391b8 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lazy-loading 'fault' on Instance uuid 0582fb9e-35d5-48a2-852a-ddd8f3497903 {{(pid=120624) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:15:47.151789 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-f3650175-91cf-4f36-a501-872bbeb2a6da tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:47.152388 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-f3650175-91cf-4f36-a501-872bbeb2a6da tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:47.158384 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f3650175-91cf-4f36-a501-872bbeb2a6da tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:47.158861 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f3650175-91cf-4f36-a501-872bbeb2a6da tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:47.159576 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f3650175-91cf-4f36-a501-872bbeb2a6da tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:47.159952 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f3650175-91cf-4f36-a501-872bbeb2a6da tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:47.160397 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f3650175-91cf-4f36-a501-872bbeb2a6da tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:47.160809 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f3650175-91cf-4f36-a501-872bbeb2a6da tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:47.161662 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-ad1c772a-6036-40cc-be43-08a4c48391b8 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:47.169919 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-ad1c772a-6036-40cc-be43-08a4c48391b8 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903" status: 200 len: 1303 microversion: 2.1 time: 0.095861 Aug 31 19:15:47.170485 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 254/518] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:47 2022] GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903 => generated 1303 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:47.221266 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-f3650175-91cf-4f36-a501-872bbeb2a6da tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:47.229326 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-f3650175-91cf-4f36-a501-872bbeb2a6da tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1203 microversion: 2.1 time: 0.080924 Aug 31 19:15:47.230139 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 265/519] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:47 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1203 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:15:47.520083 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-67a16de8-40d2-4147-a243-62816b50088f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:47.520717 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-67a16de8-40d2-4147-a243-62816b50088f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:47.527427 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-67a16de8-40d2-4147-a243-62816b50088f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:47.527943 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-67a16de8-40d2-4147-a243-62816b50088f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:47.528372 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-67a16de8-40d2-4147-a243-62816b50088f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:47.529082 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-67a16de8-40d2-4147-a243-62816b50088f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:47.529557 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-67a16de8-40d2-4147-a243-62816b50088f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:47.529974 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-67a16de8-40d2-4147-a243-62816b50088f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:47.590566 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-67a16de8-40d2-4147-a243-62816b50088f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:47.598220 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-67a16de8-40d2-4147-a243-62816b50088f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1250 microversion: 2.1 time: 0.081957 Aug 31 19:15:47.598774 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 255/520] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:47 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1250 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:47.796949 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-58e91995-7d9c-4fb4-bdfe-88df84570e64 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:47.797942 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-58e91995-7d9c-4fb4-bdfe-88df84570e64 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: 99d78918-36ca-462d-9037-ea8b81fbfc2e] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:47.812442 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-58e91995-7d9c-4fb4-bdfe-88df84570e64 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:47.813123 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-58e91995-7d9c-4fb4-bdfe-88df84570e64 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:47.813642 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-58e91995-7d9c-4fb4-bdfe-88df84570e64 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:47.814402 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-58e91995-7d9c-4fb4-bdfe-88df84570e64 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:47.814915 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-58e91995-7d9c-4fb4-bdfe-88df84570e64 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:47.815398 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-58e91995-7d9c-4fb4-bdfe-88df84570e64 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:47.880384 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:15:47.961918 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-58e91995-7d9c-4fb4-bdfe-88df84570e64 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b8da543ad543bb95881450e4f9b585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5f61674804f93bd2127fc76919bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:47.970175 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-58e91995-7d9c-4fb4-bdfe-88df84570e64 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] 10.222.0.65 "GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e" status: 200 len: 1222 microversion: 2.1 time: 0.179050 Aug 31 19:15:47.970791 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 266/521] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:47 2022] GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e => generated 1222 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:48.068053 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-bc91915c-b898-46bb-993e-e88c1eedfb54 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:48.068685 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-bc91915c-b898-46bb-993e-e88c1eedfb54 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] [instance: d7634742-9448-4848-a138-5f3f352eb832] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:48.075743 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bc91915c-b898-46bb-993e-e88c1eedfb54 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:48.076252 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bc91915c-b898-46bb-993e-e88c1eedfb54 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:48.076687 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bc91915c-b898-46bb-993e-e88c1eedfb54 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:48.077407 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bc91915c-b898-46bb-993e-e88c1eedfb54 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:48.077858 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bc91915c-b898-46bb-993e-e88c1eedfb54 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:48.078292 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bc91915c-b898-46bb-993e-e88c1eedfb54 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:48.133324 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bc91915c-b898-46bb-993e-e88c1eedfb54 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:48.133900 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bc91915c-b898-46bb-993e-e88c1eedfb54 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:48.134389 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bc91915c-b898-46bb-993e-e88c1eedfb54 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:48.135034 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.objects.instance [None req-bc91915c-b898-46bb-993e-e88c1eedfb54 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lazy-loading 'fault' on Instance uuid d7634742-9448-4848-a138-5f3f352eb832 {{(pid=120624) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:15:48.183079 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-bc91915c-b898-46bb-993e-e88c1eedfb54 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426bb2c78bce40179a0a115651b81a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e4dacbe64a48f49f697787961e1200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:48.191974 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-bc91915c-b898-46bb-993e-e88c1eedfb54 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] 10.222.0.65 "GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832" status: 200 len: 1304 microversion: 2.1 time: 0.127747 Aug 31 19:15:48.192224 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-abb8b71a-ae64-4bed-a84f-a2e2e17cf5f4 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:48.205249 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 256/522] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:48 2022] GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832 => generated 1304 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:48.206147 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-abb8b71a-ae64-4bed-a84f-a2e2e17cf5f4 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 0582fb9e-35d5-48a2-852a-ddd8f3497903] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:48.222797 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-abb8b71a-ae64-4bed-a84f-a2e2e17cf5f4 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:48.227217 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-abb8b71a-ae64-4bed-a84f-a2e2e17cf5f4 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:48.228457 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-abb8b71a-ae64-4bed-a84f-a2e2e17cf5f4 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:48.230398 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-abb8b71a-ae64-4bed-a84f-a2e2e17cf5f4 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:48.233685 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-abb8b71a-ae64-4bed-a84f-a2e2e17cf5f4 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:48.234373 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-abb8b71a-ae64-4bed-a84f-a2e2e17cf5f4 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:48.249938 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-a55e9b39-c2ae-41a7-9404-bf7d101fc5fd tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:48.251783 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-a55e9b39-c2ae-41a7-9404-bf7d101fc5fd tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:48.262850 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a55e9b39-c2ae-41a7-9404-bf7d101fc5fd tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:48.263545 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a55e9b39-c2ae-41a7-9404-bf7d101fc5fd tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:48.264159 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a55e9b39-c2ae-41a7-9404-bf7d101fc5fd tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:48.265038 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a55e9b39-c2ae-41a7-9404-bf7d101fc5fd tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:48.265733 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a55e9b39-c2ae-41a7-9404-bf7d101fc5fd tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:48.267428 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a55e9b39-c2ae-41a7-9404-bf7d101fc5fd tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:48.298722 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-abb8b71a-ae64-4bed-a84f-a2e2e17cf5f4 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:48.299924 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-abb8b71a-ae64-4bed-a84f-a2e2e17cf5f4 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:48.301812 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-abb8b71a-ae64-4bed-a84f-a2e2e17cf5f4 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:48.302401 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.objects.instance [None req-abb8b71a-ae64-4bed-a84f-a2e2e17cf5f4 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lazy-loading 'fault' on Instance uuid 0582fb9e-35d5-48a2-852a-ddd8f3497903 {{(pid=120623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:15:48.398251 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-a55e9b39-c2ae-41a7-9404-bf7d101fc5fd tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:48.408458 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-a55e9b39-c2ae-41a7-9404-bf7d101fc5fd tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1203 microversion: 2.1 time: 0.161931 Aug 31 19:15:48.420070 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 257/523] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:48 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1203 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:15:48.552649 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-abb8b71a-ae64-4bed-a84f-a2e2e17cf5f4 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c120ef02f4f6e8bea53107d90034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426e58f469324233b3514e866529eafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:48.560350 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-abb8b71a-ae64-4bed-a84f-a2e2e17cf5f4 tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903" status: 200 len: 1303 microversion: 2.1 time: 0.372267 Aug 31 19:15:48.560937 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 267/524] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:48 2022] GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903 => generated 1303 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:48.619397 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-c703db96-d8f5-424f-a743-5f683679052f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:48.620630 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-c703db96-d8f5-424f-a743-5f683679052f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:48.627002 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c703db96-d8f5-424f-a743-5f683679052f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:48.627576 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c703db96-d8f5-424f-a743-5f683679052f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:48.627932 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c703db96-d8f5-424f-a743-5f683679052f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:48.629291 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c703db96-d8f5-424f-a743-5f683679052f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:48.629758 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c703db96-d8f5-424f-a743-5f683679052f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:48.630288 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c703db96-d8f5-424f-a743-5f683679052f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:48.697566 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-c703db96-d8f5-424f-a743-5f683679052f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:48.722299 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-c703db96-d8f5-424f-a743-5f683679052f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1298 microversion: 2.1 time: 0.106803 Aug 31 19:15:48.723119 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 258/525] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:48 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1298 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:48.998980 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-de1f1954-fe11-4fec-bc90-b4c431f02d14 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:49.002316 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-de1f1954-fe11-4fec-bc90-b4c431f02d14 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: 99d78918-36ca-462d-9037-ea8b81fbfc2e] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:49.013459 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-de1f1954-fe11-4fec-bc90-b4c431f02d14 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:49.013956 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-de1f1954-fe11-4fec-bc90-b4c431f02d14 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:49.014388 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-de1f1954-fe11-4fec-bc90-b4c431f02d14 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:49.015088 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-de1f1954-fe11-4fec-bc90-b4c431f02d14 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:49.015724 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-de1f1954-fe11-4fec-bc90-b4c431f02d14 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:49.016327 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-de1f1954-fe11-4fec-bc90-b4c431f02d14 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:49.129299 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-de1f1954-fe11-4fec-bc90-b4c431f02d14 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b8da543ad543bb95881450e4f9b585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5f61674804f93bd2127fc76919bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:49.137459 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-de1f1954-fe11-4fec-bc90-b4c431f02d14 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] 10.222.0.65 "GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e" status: 200 len: 1270 microversion: 2.1 time: 0.149699 Aug 31 19:15:49.138294 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 268/526] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:48 2022] GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e => generated 1270 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:49.219300 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-9ae36321-1b6f-40d3-8b74-6766fbdca507 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:49.219915 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-9ae36321-1b6f-40d3-8b74-6766fbdca507 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] [instance: d7634742-9448-4848-a138-5f3f352eb832] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:49.226835 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9ae36321-1b6f-40d3-8b74-6766fbdca507 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:49.227364 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9ae36321-1b6f-40d3-8b74-6766fbdca507 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:49.227791 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9ae36321-1b6f-40d3-8b74-6766fbdca507 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:49.228605 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9ae36321-1b6f-40d3-8b74-6766fbdca507 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:49.230406 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9ae36321-1b6f-40d3-8b74-6766fbdca507 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:49.230847 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9ae36321-1b6f-40d3-8b74-6766fbdca507 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:49.249523 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.wsgi [None req-9ae36321-1b6f-40d3-8b74-6766fbdca507 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] HTTP exception thrown: Instance d7634742-9448-4848-a138-5f3f352eb832 could not be found. Aug 31 19:15:49.251618 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-9ae36321-1b6f-40d3-8b74-6766fbdca507 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Request method failure captured: Aug 31 19:15:49.251618 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: request: GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832 HTTP/1.1 Aug 31 19:15:49.251618 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept: application/json Aug 31 19:15:49.251618 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Aug 31 19:15:49.251618 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Connection: close Aug 31 19:15:49.251618 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Length: 0 Aug 31 19:15:49.251618 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Type: application/json Aug 31 19:15:49.251618 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Host: 10.222.0.65 Aug 31 19:15:49.251618 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Aug 31 19:15:49.251618 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Aug 31 19:15:49.251618 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjD7MscEJJIlyT-VGn77qnoW8f6GNpZDfqPrM5veoc-PQk7lYIuDk5Mr4KouU4nXzh6Mw80xVK7A-KxDv3ZDOv9B8sKiwB_ZSlguqDjCWz8AqZLdHcRW0BmHGXTEtDQwWEZpSKG6P6qBPpp3RTdpvUUN6g4m68tfTPKcqlj_DbGrSoE-Y Aug 31 19:15:49.251618 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Aug 31 19:15:49.251618 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Aug 31 19:15:49.251618 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Aug 31 19:15:49.251618 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Aug 31 19:15:49.251618 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Aug 31 19:15:49.251618 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Aug 31 19:15:49.251618 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Id: f5e4dacbe64a48f49f697787961e1200 Aug 31 19:15:49.251618 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-VolumesNegativeTest-557488527 Aug 31 19:15:49.251618 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Role: member,reader Aug 31 19:15:49.251618 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Roles: member,reader Aug 31 19:15:49.253227 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/f5e4dacbe64a48f49f697787961e1200"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f5e4dacbe64a48f49f697787961e1200"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_f5e4dacbe64a48f49f697787961e1200", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f5e4dacbe64a48f49f697787961e1200"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:15:49.253227 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-VolumesNegativeTest-557488527 Aug 31 19:15:49.253227 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Id: f5e4dacbe64a48f49f697787961e1200 Aug 31 19:15:49.253227 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-VolumesNegativeTest-557488527 Aug 31 19:15:49.253227 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User: tempest-VolumesNegativeTest-557488527-project Aug 31 19:15:49.253227 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Aug 31 19:15:49.253227 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Aug 31 19:15:49.253227 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Id: 426bb2c78bce40179a0a115651b81a5b Aug 31 19:15:49.253227 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-VolumesNegativeTest-557488527-project Aug 31 19:15:49.253227 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: method: > Aug 31 19:15:49.253227 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: exception: Instance d7634742-9448-4848-a138-5f3f352eb832 could not be found. Aug 31 19:15:49.253227 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: action_args: {'id': 'd7634742-9448-4848-a138-5f3f352eb832'} Aug 31 19:15:49.254280 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:15:49.254280 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:15:49.254280 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:15:49.254280 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:15:49.254280 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:15:49.254280 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:15:49.254280 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:15:49.254280 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:15:49.254280 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:15:49.254280 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:15:49.254280 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7634742-9448-4848-a138-5f3f352eb832 could not be found. Aug 31 19:15:49.254280 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:15:49.254280 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:15:49.254280 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:15:49.254280 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:15:49.254280 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:15:49.254280 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:15:49.254280 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:15:49.254280 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:15:49.254280 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:15:49.255733 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:15:49.255733 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:15:49.255733 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:15:49.255733 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:15:49.255733 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:15:49.255733 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:15:49.255733 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:15:49.255733 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7634742-9448-4848-a138-5f3f352eb832 could not be found. Aug 31 19:15:49.255733 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:15:49.255733 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:15:49.255733 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:15:49.255733 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:15:49.255733 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:15:49.255733 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:15:49.255733 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:15:49.255733 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:15:49.255733 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7634742-9448-4848-a138-5f3f352eb832 could not be found. Aug 31 19:15:49.255733 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:15:49.257761 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-9ae36321-1b6f-40d3-8b74-6766fbdca507 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] Returning 404 to user: Instance d7634742-9448-4848-a138-5f3f352eb832 could not be found. {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:15:49.258627 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-9ae36321-1b6f-40d3-8b74-6766fbdca507 tempest-VolumesNegativeTest-557488527 tempest-VolumesNegativeTest-557488527-project] 10.222.0.65 "GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832" status: 404 len: 111 microversion: 2.1 time: 0.049180 Aug 31 19:15:49.259185 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 259/527] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:49 2022] GET /compute/v2.1/servers/d7634742-9448-4848-a138-5f3f352eb832 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:15:49.431365 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-2b44709c-2cfd-4e9b-8406-d21dda15b471 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:49.432660 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-2b44709c-2cfd-4e9b-8406-d21dda15b471 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:49.442855 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2b44709c-2cfd-4e9b-8406-d21dda15b471 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:49.444584 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2b44709c-2cfd-4e9b-8406-d21dda15b471 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:49.445174 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2b44709c-2cfd-4e9b-8406-d21dda15b471 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:49.446443 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2b44709c-2cfd-4e9b-8406-d21dda15b471 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:49.447092 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2b44709c-2cfd-4e9b-8406-d21dda15b471 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:49.447886 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2b44709c-2cfd-4e9b-8406-d21dda15b471 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:49.582311 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-d238c961-e7f8-4264-917e-f97680cbaddd tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:49.583247 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-d238c961-e7f8-4264-917e-f97680cbaddd tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] [instance: 0582fb9e-35d5-48a2-852a-ddd8f3497903] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:49.592910 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d238c961-e7f8-4264-917e-f97680cbaddd tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:49.593777 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d238c961-e7f8-4264-917e-f97680cbaddd tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:49.594276 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d238c961-e7f8-4264-917e-f97680cbaddd tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:49.595189 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d238c961-e7f8-4264-917e-f97680cbaddd tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:49.595617 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d238c961-e7f8-4264-917e-f97680cbaddd tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:49.596040 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d238c961-e7f8-4264-917e-f97680cbaddd tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:49.612381 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.wsgi [None req-d238c961-e7f8-4264-917e-f97680cbaddd tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] HTTP exception thrown: Instance 0582fb9e-35d5-48a2-852a-ddd8f3497903 could not be found. Aug 31 19:15:49.614690 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-d238c961-e7f8-4264-917e-f97680cbaddd tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Request method failure captured: Aug 31 19:15:49.614690 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: request: GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903 HTTP/1.1 Aug 31 19:15:49.614690 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept: application/json Aug 31 19:15:49.614690 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Aug 31 19:15:49.614690 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Connection: close Aug 31 19:15:49.614690 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Length: 0 Aug 31 19:15:49.614690 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Type: application/json Aug 31 19:15:49.614690 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Host: 10.222.0.65 Aug 31 19:15:49.614690 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Aug 31 19:15:49.614690 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Aug 31 19:15:49.614690 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjD7L0HTeIZFhl6Riar37GVGvguaWDFa4RUXTfOvKGJx-vTnKDOeQHIWpg8dOuaNJp82S8ZvpjTsg06FxV1rAdD24dkhMEceRLojLioEWagu-LZpbue8JyIJEvsiEyN_gYI8xdcrG_24dohm2tATK4j41uq8Hl1jkDDVgHVLvbZr2c5as Aug 31 19:15:49.614690 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Aug 31 19:15:49.614690 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Aug 31 19:15:49.614690 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Aug 31 19:15:49.614690 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Aug 31 19:15:49.614690 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Aug 31 19:15:49.614690 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Aug 31 19:15:49.614690 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Id: 426e58f469324233b3514e866529eafa Aug 31 19:15:49.614690 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-VolumesActionsTest-612244936 Aug 31 19:15:49.614690 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Role: member,reader Aug 31 19:15:49.614690 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Roles: member,reader Aug 31 19:15:49.616178 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/426e58f469324233b3514e866529eafa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/426e58f469324233b3514e866529eafa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_426e58f469324233b3514e866529eafa", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/426e58f469324233b3514e866529eafa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:15:49.616178 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-VolumesActionsTest-612244936 Aug 31 19:15:49.616178 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Id: 426e58f469324233b3514e866529eafa Aug 31 19:15:49.616178 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-VolumesActionsTest-612244936 Aug 31 19:15:49.616178 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User: tempest-VolumesActionsTest-612244936-project Aug 31 19:15:49.616178 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Aug 31 19:15:49.616178 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Aug 31 19:15:49.616178 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Id: e33c120ef02f4f6e8bea53107d90034b Aug 31 19:15:49.616178 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-VolumesActionsTest-612244936-project Aug 31 19:15:49.616178 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: method: > Aug 31 19:15:49.616178 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: exception: Instance 0582fb9e-35d5-48a2-852a-ddd8f3497903 could not be found. Aug 31 19:15:49.616178 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: action_args: {'id': '0582fb9e-35d5-48a2-852a-ddd8f3497903'} Aug 31 19:15:49.617031 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:15:49.617031 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:15:49.617031 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:15:49.617031 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:15:49.617031 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:15:49.617031 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:15:49.617031 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:15:49.617031 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:15:49.617031 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:15:49.617031 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:15:49.617031 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0582fb9e-35d5-48a2-852a-ddd8f3497903 could not be found. Aug 31 19:15:49.617031 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:15:49.617031 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:15:49.617031 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:15:49.617031 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:15:49.617031 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:15:49.617031 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:15:49.617031 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:15:49.617031 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:15:49.617031 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:15:49.618212 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:15:49.618212 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:15:49.618212 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:15:49.618212 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:15:49.618212 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:15:49.618212 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:15:49.618212 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:15:49.618212 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0582fb9e-35d5-48a2-852a-ddd8f3497903 could not be found. Aug 31 19:15:49.618212 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:15:49.618212 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:15:49.618212 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:15:49.618212 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:15:49.618212 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:15:49.618212 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:15:49.618212 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:15:49.618212 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:15:49.618212 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0582fb9e-35d5-48a2-852a-ddd8f3497903 could not be found. Aug 31 19:15:49.618212 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:15:49.619406 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-d238c961-e7f8-4264-917e-f97680cbaddd tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] Returning 404 to user: Instance 0582fb9e-35d5-48a2-852a-ddd8f3497903 could not be found. {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:15:49.619406 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-d238c961-e7f8-4264-917e-f97680cbaddd tempest-VolumesActionsTest-612244936 tempest-VolumesActionsTest-612244936-project] 10.222.0.65 "GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903" status: 404 len: 111 microversion: 2.1 time: 0.037945 Aug 31 19:15:49.619406 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 260/528] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:49 2022] GET /compute/v2.1/servers/0582fb9e-35d5-48a2-852a-ddd8f3497903 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 19:15:49.687538 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-7c714bc8-7c20-4149-b532-7865e1192fe3 req-fd0cc775-f5c3-4a96-b4cf-b936c16c774a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52d843ca-5f08-47f6-98dc-2df1d30438cc", "tag": "4fdbfd0c-e43a-4c2c-ab61-0f67e2dfee09"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:15:49.699165 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-7c714bc8-7c20-4149-b532-7865e1192fe3 req-fd0cc775-f5c3-4a96-b4cf-b936c16c774a service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:49.700488 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-7c714bc8-7c20-4149-b532-7865e1192fe3 req-fd0cc775-f5c3-4a96-b4cf-b936c16c774a service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:49.701158 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-7c714bc8-7c20-4149-b532-7865e1192fe3 req-fd0cc775-f5c3-4a96-b4cf-b936c16c774a service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:49.715255 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-7c714bc8-7c20-4149-b532-7865e1192fe3 req-fd0cc775-f5c3-4a96-b4cf-b936c16c774a service nova] Creating event network-changed:4fdbfd0c-e43a-4c2c-ab61-0f67e2dfee09 for instance 52d843ca-5f08-47f6-98dc-2df1d30438cc on hv-cinder-83538 Aug 31 19:15:49.723515 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-7c714bc8-7c20-4149-b532-7865e1192fe3 req-fd0cc775-f5c3-4a96-b4cf-b936c16c774a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040164 Aug 31 19:15:49.724878 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 261/529] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:15:49.727307 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-2b44709c-2cfd-4e9b-8406-d21dda15b471 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:49.737668 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-2b44709c-2cfd-4e9b-8406-d21dda15b471 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1271 microversion: 2.1 time: 0.311211 Aug 31 19:15:49.738239 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 269/530] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:49 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1271 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:49.754011 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-45a9e5a2-6fac-4beb-a36b-f9fa103d3400 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:49.755071 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-45a9e5a2-6fac-4beb-a36b-f9fa103d3400 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:49.767912 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-45a9e5a2-6fac-4beb-a36b-f9fa103d3400 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:49.768094 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-45a9e5a2-6fac-4beb-a36b-f9fa103d3400 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:49.768524 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-45a9e5a2-6fac-4beb-a36b-f9fa103d3400 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:49.769250 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-45a9e5a2-6fac-4beb-a36b-f9fa103d3400 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:49.769676 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-45a9e5a2-6fac-4beb-a36b-f9fa103d3400 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:49.770085 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-45a9e5a2-6fac-4beb-a36b-f9fa103d3400 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:49.843952 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-45a9e5a2-6fac-4beb-a36b-f9fa103d3400 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:49.851929 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-45a9e5a2-6fac-4beb-a36b-f9fa103d3400 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1306 microversion: 2.1 time: 0.102765 Aug 31 19:15:49.852568 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 262/531] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:49 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1306 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:50.159802 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d9e0b784-0bd9-437d-97d4-5af3db8c3c7c tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:50.160434 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d9e0b784-0bd9-437d-97d4-5af3db8c3c7c tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: 99d78918-36ca-462d-9037-ea8b81fbfc2e] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:50.166764 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d9e0b784-0bd9-437d-97d4-5af3db8c3c7c tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:50.167242 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d9e0b784-0bd9-437d-97d4-5af3db8c3c7c tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:50.167668 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d9e0b784-0bd9-437d-97d4-5af3db8c3c7c tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:50.168349 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d9e0b784-0bd9-437d-97d4-5af3db8c3c7c tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:50.168791 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d9e0b784-0bd9-437d-97d4-5af3db8c3c7c tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:50.169217 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d9e0b784-0bd9-437d-97d4-5af3db8c3c7c tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:50.254200 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-d9e0b784-0bd9-437d-97d4-5af3db8c3c7c tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b8da543ad543bb95881450e4f9b585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5f61674804f93bd2127fc76919bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:50.262618 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-d9e0b784-0bd9-437d-97d4-5af3db8c3c7c tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] 10.222.0.65 "GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e" status: 200 len: 1278 microversion: 2.1 time: 0.106613 Aug 31 19:15:50.263750 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 270/532] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:50 2022] GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e => generated 1278 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:15:50.759564 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-dc641a27-00e7-497b-98f8-1219f7f160e1 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:50.760714 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-dc641a27-00e7-497b-98f8-1219f7f160e1 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:50.767428 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dc641a27-00e7-497b-98f8-1219f7f160e1 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:50.768086 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dc641a27-00e7-497b-98f8-1219f7f160e1 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:50.768514 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dc641a27-00e7-497b-98f8-1219f7f160e1 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:50.769220 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dc641a27-00e7-497b-98f8-1219f7f160e1 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:50.769795 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dc641a27-00e7-497b-98f8-1219f7f160e1 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:50.770146 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dc641a27-00e7-497b-98f8-1219f7f160e1 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:50.874302 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-481754b8-2e57-4abf-aa56-f2de42b20bc5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:50.874838 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-481754b8-2e57-4abf-aa56-f2de42b20bc5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:50.880965 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-481754b8-2e57-4abf-aa56-f2de42b20bc5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:50.881482 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-481754b8-2e57-4abf-aa56-f2de42b20bc5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:50.881915 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-481754b8-2e57-4abf-aa56-f2de42b20bc5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:50.882598 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-481754b8-2e57-4abf-aa56-f2de42b20bc5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:50.883040 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-481754b8-2e57-4abf-aa56-f2de42b20bc5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:50.883567 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-481754b8-2e57-4abf-aa56-f2de42b20bc5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:50.908451 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-dc641a27-00e7-497b-98f8-1219f7f160e1 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:50.918296 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-dc641a27-00e7-497b-98f8-1219f7f160e1 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1271 microversion: 2.1 time: 0.162504 Aug 31 19:15:50.918940 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 263/533] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:50 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1271 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:50.947838 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-481754b8-2e57-4abf-aa56-f2de42b20bc5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:50.955645 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-481754b8-2e57-4abf-aa56-f2de42b20bc5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1306 microversion: 2.1 time: 0.085114 Aug 31 19:15:50.956142 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 271/534] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:50 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1306 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:51.284437 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-db19a18b-90ac-4c1f-9614-ddc630cc304f tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:51.285134 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-db19a18b-90ac-4c1f-9614-ddc630cc304f tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: 99d78918-36ca-462d-9037-ea8b81fbfc2e] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:51.292303 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-db19a18b-90ac-4c1f-9614-ddc630cc304f tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:51.292766 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-db19a18b-90ac-4c1f-9614-ddc630cc304f tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:51.293219 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-db19a18b-90ac-4c1f-9614-ddc630cc304f tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:51.293908 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-db19a18b-90ac-4c1f-9614-ddc630cc304f tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:51.294351 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-db19a18b-90ac-4c1f-9614-ddc630cc304f tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:51.294768 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-db19a18b-90ac-4c1f-9614-ddc630cc304f tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:51.313676 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=100 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:15:51.368249 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-db19a18b-90ac-4c1f-9614-ddc630cc304f tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b8da543ad543bb95881450e4f9b585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5f61674804f93bd2127fc76919bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:51.376313 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-db19a18b-90ac-4c1f-9614-ddc630cc304f tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] 10.222.0.65 "GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e" status: 200 len: 1278 microversion: 2.1 time: 0.095736 Aug 31 19:15:51.376884 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 264/535] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:51 2022] GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e => generated 1278 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:15:51.939097 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-51014c17-1699-4a5b-86d1-954256cc0a1a tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:51.939813 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-51014c17-1699-4a5b-86d1-954256cc0a1a tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:51.946371 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-51014c17-1699-4a5b-86d1-954256cc0a1a tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:51.946906 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-51014c17-1699-4a5b-86d1-954256cc0a1a tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:51.947409 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-51014c17-1699-4a5b-86d1-954256cc0a1a tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:51.948734 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-51014c17-1699-4a5b-86d1-954256cc0a1a tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:51.949349 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-51014c17-1699-4a5b-86d1-954256cc0a1a tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:51.949841 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-51014c17-1699-4a5b-86d1-954256cc0a1a tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:51.976539 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-a0742b53-960d-4e0a-a534-68c1b426f2e0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:51.977250 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-a0742b53-960d-4e0a-a534-68c1b426f2e0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:51.983437 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a0742b53-960d-4e0a-a534-68c1b426f2e0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:51.983918 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a0742b53-960d-4e0a-a534-68c1b426f2e0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:51.984349 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a0742b53-960d-4e0a-a534-68c1b426f2e0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:51.985039 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a0742b53-960d-4e0a-a534-68c1b426f2e0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:51.989879 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a0742b53-960d-4e0a-a534-68c1b426f2e0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:51.990455 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a0742b53-960d-4e0a-a534-68c1b426f2e0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:52.075516 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-a0742b53-960d-4e0a-a534-68c1b426f2e0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:52.082600 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-a0742b53-960d-4e0a-a534-68c1b426f2e0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1306 microversion: 2.1 time: 0.109732 Aug 31 19:15:52.083348 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 265/536] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:51 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1306 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:52.119169 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-51014c17-1699-4a5b-86d1-954256cc0a1a tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:52.127431 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-51014c17-1699-4a5b-86d1-954256cc0a1a tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1271 microversion: 2.1 time: 0.192565 Aug 31 19:15:52.128196 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 272/537] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:51 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1271 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:15:52.397205 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-2a9ab01f-19c4-4123-a318-fc05886d8630 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:52.397820 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-2a9ab01f-19c4-4123-a318-fc05886d8630 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: 99d78918-36ca-462d-9037-ea8b81fbfc2e] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:52.403721 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2a9ab01f-19c4-4123-a318-fc05886d8630 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:52.404241 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2a9ab01f-19c4-4123-a318-fc05886d8630 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:52.404675 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2a9ab01f-19c4-4123-a318-fc05886d8630 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:52.405391 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2a9ab01f-19c4-4123-a318-fc05886d8630 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:52.405842 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2a9ab01f-19c4-4123-a318-fc05886d8630 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:52.406264 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2a9ab01f-19c4-4123-a318-fc05886d8630 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:52.465772 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-2a9ab01f-19c4-4123-a318-fc05886d8630 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b8da543ad543bb95881450e4f9b585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5f61674804f93bd2127fc76919bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:52.473659 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-2a9ab01f-19c4-4123-a318-fc05886d8630 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] 10.222.0.65 "GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e" status: 200 len: 1278 microversion: 2.1 time: 0.080345 Aug 31 19:15:52.474219 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 266/538] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:52 2022] GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e => generated 1278 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:53.104590 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-59b155a6-4eec-4741-b9e6-c1e88bcd17f5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:53.105491 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-59b155a6-4eec-4741-b9e6-c1e88bcd17f5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:53.111641 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-59b155a6-4eec-4741-b9e6-c1e88bcd17f5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:53.112121 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-59b155a6-4eec-4741-b9e6-c1e88bcd17f5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:53.112555 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-59b155a6-4eec-4741-b9e6-c1e88bcd17f5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:53.113267 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-59b155a6-4eec-4741-b9e6-c1e88bcd17f5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:53.113724 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-59b155a6-4eec-4741-b9e6-c1e88bcd17f5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:53.114146 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-59b155a6-4eec-4741-b9e6-c1e88bcd17f5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:53.148211 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-f49e8279-5387-4fe5-a664-2e00ac16d1c1 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:53.148809 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-f49e8279-5387-4fe5-a664-2e00ac16d1c1 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:53.155887 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f49e8279-5387-4fe5-a664-2e00ac16d1c1 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:53.156365 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f49e8279-5387-4fe5-a664-2e00ac16d1c1 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:53.156788 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f49e8279-5387-4fe5-a664-2e00ac16d1c1 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:53.157494 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f49e8279-5387-4fe5-a664-2e00ac16d1c1 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:53.157938 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f49e8279-5387-4fe5-a664-2e00ac16d1c1 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:53.158444 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f49e8279-5387-4fe5-a664-2e00ac16d1c1 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:53.175657 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-59b155a6-4eec-4741-b9e6-c1e88bcd17f5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:53.183380 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-59b155a6-4eec-4741-b9e6-c1e88bcd17f5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1306 microversion: 2.1 time: 0.083304 Aug 31 19:15:53.184127 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 273/539] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:53 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1306 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:53.297090 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-f49e8279-5387-4fe5-a664-2e00ac16d1c1 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:53.305141 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-f49e8279-5387-4fe5-a664-2e00ac16d1c1 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1271 microversion: 2.1 time: 0.160721 Aug 31 19:15:53.305826 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 267/540] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:53 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1271 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:15:53.494617 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-97827ada-ff5d-4608-8687-09e3fbdcb31b tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:53.495263 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-97827ada-ff5d-4608-8687-09e3fbdcb31b tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: 99d78918-36ca-462d-9037-ea8b81fbfc2e] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:53.502269 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-97827ada-ff5d-4608-8687-09e3fbdcb31b tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:53.502757 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-97827ada-ff5d-4608-8687-09e3fbdcb31b tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:53.503216 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-97827ada-ff5d-4608-8687-09e3fbdcb31b tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:53.504112 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-97827ada-ff5d-4608-8687-09e3fbdcb31b tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:53.504559 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-97827ada-ff5d-4608-8687-09e3fbdcb31b tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:53.505274 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-97827ada-ff5d-4608-8687-09e3fbdcb31b tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:53.664486 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-97827ada-ff5d-4608-8687-09e3fbdcb31b tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b8da543ad543bb95881450e4f9b585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5f61674804f93bd2127fc76919bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:53.676561 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-97827ada-ff5d-4608-8687-09e3fbdcb31b tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] 10.222.0.65 "GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e" status: 200 len: 1278 microversion: 2.1 time: 0.183731 Aug 31 19:15:53.691391 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 274/541] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:53 2022] GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e => generated 1278 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:54.203670 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-39f77f14-939b-451d-840f-a0eb9ad03a60 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:54.204265 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-39f77f14-939b-451d-840f-a0eb9ad03a60 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:54.219492 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-39f77f14-939b-451d-840f-a0eb9ad03a60 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:54.220153 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-39f77f14-939b-451d-840f-a0eb9ad03a60 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:54.220749 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-39f77f14-939b-451d-840f-a0eb9ad03a60 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:54.221611 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-39f77f14-939b-451d-840f-a0eb9ad03a60 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:54.222203 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-39f77f14-939b-451d-840f-a0eb9ad03a60 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:54.222813 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-39f77f14-939b-451d-840f-a0eb9ad03a60 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:54.312698 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-39f77f14-939b-451d-840f-a0eb9ad03a60 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:54.329621 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e6c1887a-57a8-4add-bb74-a2233ac9c2a2 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:54.330003 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-e6c1887a-57a8-4add-bb74-a2233ac9c2a2 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:54.335796 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-39f77f14-939b-451d-840f-a0eb9ad03a60 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1304 microversion: 2.1 time: 0.135917 Aug 31 19:15:54.336475 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 268/542] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:54 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1304 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:54.340408 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e6c1887a-57a8-4add-bb74-a2233ac9c2a2 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:54.340786 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e6c1887a-57a8-4add-bb74-a2233ac9c2a2 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:54.341242 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e6c1887a-57a8-4add-bb74-a2233ac9c2a2 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:54.342119 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e6c1887a-57a8-4add-bb74-a2233ac9c2a2 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:54.342874 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e6c1887a-57a8-4add-bb74-a2233ac9c2a2 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:54.343306 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e6c1887a-57a8-4add-bb74-a2233ac9c2a2 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:54.700129 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-6ffc4f4c-cbfd-4237-9713-96447d98c3d0 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:54.700494 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e6c1887a-57a8-4add-bb74-a2233ac9c2a2 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:54.701237 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-6ffc4f4c-cbfd-4237-9713-96447d98c3d0 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: 99d78918-36ca-462d-9037-ea8b81fbfc2e] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:54.704476 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell0:SELECT=2 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:15:54.709389 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6ffc4f4c-cbfd-4237-9713-96447d98c3d0 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:54.710314 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6ffc4f4c-cbfd-4237-9713-96447d98c3d0 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:54.711488 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6ffc4f4c-cbfd-4237-9713-96447d98c3d0 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:54.712413 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6ffc4f4c-cbfd-4237-9713-96447d98c3d0 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:54.713110 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6ffc4f4c-cbfd-4237-9713-96447d98c3d0 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:54.714023 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-e6c1887a-57a8-4add-bb74-a2233ac9c2a2 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1259 microversion: 2.1 time: 0.390426 Aug 31 19:15:54.714461 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6ffc4f4c-cbfd-4237-9713-96447d98c3d0 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:54.715206 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 275/543] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:54 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1259 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:54.969878 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-6ffc4f4c-cbfd-4237-9713-96447d98c3d0 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b8da543ad543bb95881450e4f9b585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5f61674804f93bd2127fc76919bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:54.985792 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-6ffc4f4c-cbfd-4237-9713-96447d98c3d0 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] 10.222.0.65 "GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e" status: 200 len: 1318 microversion: 2.1 time: 0.289683 Aug 31 19:15:54.987418 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 269/544] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:54 2022] GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e => generated 1318 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:15:55.097707 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-ed973444-bacd-4794-99e2-9fe57704532f req-a2c07208-1487-4adc-9132-5609097d2017 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99d78918-36ca-462d-9037-ea8b81fbfc2e", "tag": "26de47b8-1d7b-4d14-aacf-b275eb478d29"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:15:55.108078 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-ed973444-bacd-4794-99e2-9fe57704532f req-a2c07208-1487-4adc-9132-5609097d2017 service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:55.108939 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-ed973444-bacd-4794-99e2-9fe57704532f req-a2c07208-1487-4adc-9132-5609097d2017 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:55.109547 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-ed973444-bacd-4794-99e2-9fe57704532f req-a2c07208-1487-4adc-9132-5609097d2017 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:55.134502 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-ed973444-bacd-4794-99e2-9fe57704532f req-a2c07208-1487-4adc-9132-5609097d2017 service nova] Creating event network-changed:26de47b8-1d7b-4d14-aacf-b275eb478d29 for instance 99d78918-36ca-462d-9037-ea8b81fbfc2e on hv-cinder-83538 Aug 31 19:15:55.140405 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-ed973444-bacd-4794-99e2-9fe57704532f req-a2c07208-1487-4adc-9132-5609097d2017 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046348 Aug 31 19:15:55.141579 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 276/545] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:15:55.358063 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-c46c7941-81e8-47bb-8fe2-11e8876c797b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:55.358693 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-c46c7941-81e8-47bb-8fe2-11e8876c797b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:55.365979 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c46c7941-81e8-47bb-8fe2-11e8876c797b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:55.366639 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c46c7941-81e8-47bb-8fe2-11e8876c797b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:55.367308 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c46c7941-81e8-47bb-8fe2-11e8876c797b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:55.368196 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c46c7941-81e8-47bb-8fe2-11e8876c797b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:55.368652 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c46c7941-81e8-47bb-8fe2-11e8876c797b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:55.370313 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c46c7941-81e8-47bb-8fe2-11e8876c797b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:55.400162 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell0:SELECT=12 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:15:55.566710 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-c46c7941-81e8-47bb-8fe2-11e8876c797b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:55.574510 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-c46c7941-81e8-47bb-8fe2-11e8876c797b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1372 microversion: 2.1 time: 0.220572 Aug 31 19:15:55.575072 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 270/546] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:55 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1372 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:55.693610 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell0:SELECT=2 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:15:55.694409 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell0:SELECT=8 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:15:55.698790 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-98cea1ce-6fe7-4a84-987e-dbd023f8dd6f req-a69838eb-9550-4c17-baab-10a7ee523d68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c81a2adf-d0a7-44b6-abf6-74f03fe93857", "tag": "2ccb095c-a665-47ff-bcff-65a4dc08d119"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:15:55.709236 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-98cea1ce-6fe7-4a84-987e-dbd023f8dd6f req-a69838eb-9550-4c17-baab-10a7ee523d68 service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:55.709724 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-98cea1ce-6fe7-4a84-987e-dbd023f8dd6f req-a69838eb-9550-4c17-baab-10a7ee523d68 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:55.710243 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-98cea1ce-6fe7-4a84-987e-dbd023f8dd6f req-a69838eb-9550-4c17-baab-10a7ee523d68 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:55.721461 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-98cea1ce-6fe7-4a84-987e-dbd023f8dd6f req-a69838eb-9550-4c17-baab-10a7ee523d68 service nova] Creating event network-changed:2ccb095c-a665-47ff-bcff-65a4dc08d119 for instance c81a2adf-d0a7-44b6-abf6-74f03fe93857 on hv-cinder-83538 Aug 31 19:15:55.725927 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-98cea1ce-6fe7-4a84-987e-dbd023f8dd6f req-a69838eb-9550-4c17-baab-10a7ee523d68 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033125 Aug 31 19:15:55.726512 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 277/547] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:15:55.735613 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-48addfb8-ef26-473e-b074-d85bd8fe3e82 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:55.736220 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-48addfb8-ef26-473e-b074-d85bd8fe3e82 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:55.742193 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-48addfb8-ef26-473e-b074-d85bd8fe3e82 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:55.742676 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-48addfb8-ef26-473e-b074-d85bd8fe3e82 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:55.743139 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-48addfb8-ef26-473e-b074-d85bd8fe3e82 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:55.743823 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-48addfb8-ef26-473e-b074-d85bd8fe3e82 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:55.744279 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-48addfb8-ef26-473e-b074-d85bd8fe3e82 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:55.744747 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-48addfb8-ef26-473e-b074-d85bd8fe3e82 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:55.875436 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-48addfb8-ef26-473e-b074-d85bd8fe3e82 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:55.883187 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-48addfb8-ef26-473e-b074-d85bd8fe3e82 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1259 microversion: 2.1 time: 0.151375 Aug 31 19:15:55.883739 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 271/548] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:55 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:56.008208 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-37f94627-21f8-463b-8797-9e1eb16da89a tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:56.008914 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-37f94627-21f8-463b-8797-9e1eb16da89a tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: 99d78918-36ca-462d-9037-ea8b81fbfc2e] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:56.010826 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:15:56.016160 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-37f94627-21f8-463b-8797-9e1eb16da89a tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:56.016635 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-37f94627-21f8-463b-8797-9e1eb16da89a tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:56.017065 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-37f94627-21f8-463b-8797-9e1eb16da89a tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:56.017763 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-37f94627-21f8-463b-8797-9e1eb16da89a tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:56.018207 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-37f94627-21f8-463b-8797-9e1eb16da89a tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:56.018618 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-37f94627-21f8-463b-8797-9e1eb16da89a tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:56.151669 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-37f94627-21f8-463b-8797-9e1eb16da89a tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b8da543ad543bb95881450e4f9b585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5f61674804f93bd2127fc76919bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:56.159250 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-37f94627-21f8-463b-8797-9e1eb16da89a tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] 10.222.0.65 "GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e" status: 200 len: 1318 microversion: 2.1 time: 0.155185 Aug 31 19:15:56.159813 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 278/549] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:56 2022] GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:56.594472 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-08d89709-f5dc-4797-be0b-dd19bbdffdf0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:56.595078 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-08d89709-f5dc-4797-be0b-dd19bbdffdf0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:56.601680 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-08d89709-f5dc-4797-be0b-dd19bbdffdf0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:56.602155 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-08d89709-f5dc-4797-be0b-dd19bbdffdf0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:56.602582 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-08d89709-f5dc-4797-be0b-dd19bbdffdf0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:56.603295 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-08d89709-f5dc-4797-be0b-dd19bbdffdf0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:56.603743 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-08d89709-f5dc-4797-be0b-dd19bbdffdf0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:56.604157 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-08d89709-f5dc-4797-be0b-dd19bbdffdf0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:56.730383 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-08d89709-f5dc-4797-be0b-dd19bbdffdf0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:56.738019 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-08d89709-f5dc-4797-be0b-dd19bbdffdf0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1372 microversion: 2.1 time: 0.147288 Aug 31 19:15:56.738776 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 272/550] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:56 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1372 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:56.903868 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-8ecefc39-4d7e-4539-90d3-caf4bcd853a4 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:56.904468 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-8ecefc39-4d7e-4539-90d3-caf4bcd853a4 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:56.910317 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8ecefc39-4d7e-4539-90d3-caf4bcd853a4 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:56.910790 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8ecefc39-4d7e-4539-90d3-caf4bcd853a4 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:56.911245 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8ecefc39-4d7e-4539-90d3-caf4bcd853a4 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:56.911917 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8ecefc39-4d7e-4539-90d3-caf4bcd853a4 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:56.912361 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8ecefc39-4d7e-4539-90d3-caf4bcd853a4 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:56.912770 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8ecefc39-4d7e-4539-90d3-caf4bcd853a4 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:57.044145 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-8ecefc39-4d7e-4539-90d3-caf4bcd853a4 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:57.051710 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-8ecefc39-4d7e-4539-90d3-caf4bcd853a4 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1259 microversion: 2.1 time: 0.151772 Aug 31 19:15:57.052257 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 279/551] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:56 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:57.178845 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-c123c8f1-3908-4eae-b872-9bc63450b9fa tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:57.179366 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-c123c8f1-3908-4eae-b872-9bc63450b9fa tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: 99d78918-36ca-462d-9037-ea8b81fbfc2e] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:57.185979 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c123c8f1-3908-4eae-b872-9bc63450b9fa tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:57.186458 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c123c8f1-3908-4eae-b872-9bc63450b9fa tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:57.186882 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c123c8f1-3908-4eae-b872-9bc63450b9fa tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:57.187563 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c123c8f1-3908-4eae-b872-9bc63450b9fa tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:57.188011 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c123c8f1-3908-4eae-b872-9bc63450b9fa tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:57.188427 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c123c8f1-3908-4eae-b872-9bc63450b9fa tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:57.315905 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-c123c8f1-3908-4eae-b872-9bc63450b9fa tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b8da543ad543bb95881450e4f9b585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5f61674804f93bd2127fc76919bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:57.323594 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-c123c8f1-3908-4eae-b872-9bc63450b9fa tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] 10.222.0.65 "GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e" status: 200 len: 1318 microversion: 2.1 time: 0.148720 Aug 31 19:15:57.324155 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 273/552] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:57 2022] GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:57.759254 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-02872bf0-45d3-4f58-b3a3-28dcd4d036ce tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:57.760366 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-02872bf0-45d3-4f58-b3a3-28dcd4d036ce tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:57.766371 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-02872bf0-45d3-4f58-b3a3-28dcd4d036ce tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:57.766857 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-02872bf0-45d3-4f58-b3a3-28dcd4d036ce tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:57.767289 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-02872bf0-45d3-4f58-b3a3-28dcd4d036ce tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:57.767974 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-02872bf0-45d3-4f58-b3a3-28dcd4d036ce tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:57.768435 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-02872bf0-45d3-4f58-b3a3-28dcd4d036ce tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:57.768857 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-02872bf0-45d3-4f58-b3a3-28dcd4d036ce tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:57.893584 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-02872bf0-45d3-4f58-b3a3-28dcd4d036ce tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:57.901632 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-02872bf0-45d3-4f58-b3a3-28dcd4d036ce tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1372 microversion: 2.1 time: 0.146489 Aug 31 19:15:57.902341 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 280/553] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:57 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1372 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:58.074298 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-723c6fb0-0236-48ed-8930-979a9b0ad5e4 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:58.074837 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-723c6fb0-0236-48ed-8930-979a9b0ad5e4 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:58.081170 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-723c6fb0-0236-48ed-8930-979a9b0ad5e4 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:58.081682 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-723c6fb0-0236-48ed-8930-979a9b0ad5e4 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:58.082109 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-723c6fb0-0236-48ed-8930-979a9b0ad5e4 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:58.082788 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-723c6fb0-0236-48ed-8930-979a9b0ad5e4 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:58.083232 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-723c6fb0-0236-48ed-8930-979a9b0ad5e4 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:58.083645 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-723c6fb0-0236-48ed-8930-979a9b0ad5e4 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:58.215025 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-723c6fb0-0236-48ed-8930-979a9b0ad5e4 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:58.222713 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-723c6fb0-0236-48ed-8930-979a9b0ad5e4 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1259 microversion: 2.1 time: 0.152956 Aug 31 19:15:58.223266 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 274/554] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:58 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:58.344132 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-67d82e0d-d9b5-4810-be26-9e0acb3421f5 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:58.344681 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-67d82e0d-d9b5-4810-be26-9e0acb3421f5 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: 99d78918-36ca-462d-9037-ea8b81fbfc2e] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:58.350735 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-67d82e0d-d9b5-4810-be26-9e0acb3421f5 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:58.351219 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-67d82e0d-d9b5-4810-be26-9e0acb3421f5 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:58.351656 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-67d82e0d-d9b5-4810-be26-9e0acb3421f5 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:58.352340 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-67d82e0d-d9b5-4810-be26-9e0acb3421f5 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:58.352793 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-67d82e0d-d9b5-4810-be26-9e0acb3421f5 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:58.353245 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-67d82e0d-d9b5-4810-be26-9e0acb3421f5 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:58.477509 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-67d82e0d-d9b5-4810-be26-9e0acb3421f5 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b8da543ad543bb95881450e4f9b585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5f61674804f93bd2127fc76919bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:58.485655 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-67d82e0d-d9b5-4810-be26-9e0acb3421f5 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] 10.222.0.65 "GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e" status: 200 len: 1318 microversion: 2.1 time: 0.145440 Aug 31 19:15:58.486218 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 281/555] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:58 2022] GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:58.922502 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-cbb17236-9fd1-4e96-9b68-ea2c92a97369 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:58.923019 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-cbb17236-9fd1-4e96-9b68-ea2c92a97369 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:58.929318 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cbb17236-9fd1-4e96-9b68-ea2c92a97369 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:58.930003 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cbb17236-9fd1-4e96-9b68-ea2c92a97369 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:58.930344 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cbb17236-9fd1-4e96-9b68-ea2c92a97369 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:58.931184 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cbb17236-9fd1-4e96-9b68-ea2c92a97369 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:58.931711 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cbb17236-9fd1-4e96-9b68-ea2c92a97369 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:58.932231 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cbb17236-9fd1-4e96-9b68-ea2c92a97369 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:59.063348 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-cbb17236-9fd1-4e96-9b68-ea2c92a97369 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:59.071135 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-cbb17236-9fd1-4e96-9b68-ea2c92a97369 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1372 microversion: 2.1 time: 0.153165 Aug 31 19:15:59.071705 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 275/556] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:58 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:59.243394 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-b6823a73-c0f2-412a-a1fa-2acdd726a154 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:59.244002 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-b6823a73-c0f2-412a-a1fa-2acdd726a154 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:59.249939 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b6823a73-c0f2-412a-a1fa-2acdd726a154 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:59.250417 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b6823a73-c0f2-412a-a1fa-2acdd726a154 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:59.250872 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b6823a73-c0f2-412a-a1fa-2acdd726a154 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:59.251529 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b6823a73-c0f2-412a-a1fa-2acdd726a154 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:59.252007 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b6823a73-c0f2-412a-a1fa-2acdd726a154 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:59.252422 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b6823a73-c0f2-412a-a1fa-2acdd726a154 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:59.383252 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-b6823a73-c0f2-412a-a1fa-2acdd726a154 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:59.391483 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-b6823a73-c0f2-412a-a1fa-2acdd726a154 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1259 microversion: 2.1 time: 0.151918 Aug 31 19:15:59.392037 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 282/557] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:59 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:15:59.506696 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-58713ec8-2540-48ab-ad12-7e89303bb9b2 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:59.507326 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-58713ec8-2540-48ab-ad12-7e89303bb9b2 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: 99d78918-36ca-462d-9037-ea8b81fbfc2e] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:15:59.514207 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-58713ec8-2540-48ab-ad12-7e89303bb9b2 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:59.514681 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-58713ec8-2540-48ab-ad12-7e89303bb9b2 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:59.515108 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-58713ec8-2540-48ab-ad12-7e89303bb9b2 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:59.515783 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-58713ec8-2540-48ab-ad12-7e89303bb9b2 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:59.516227 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-58713ec8-2540-48ab-ad12-7e89303bb9b2 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:59.516643 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-58713ec8-2540-48ab-ad12-7e89303bb9b2 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:59.649777 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-58713ec8-2540-48ab-ad12-7e89303bb9b2 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b8da543ad543bb95881450e4f9b585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5f61674804f93bd2127fc76919bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:15:59.657479 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-58713ec8-2540-48ab-ad12-7e89303bb9b2 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] 10.222.0.65 "GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e" status: 200 len: 1318 microversion: 2.1 time: 0.154388 Aug 31 19:15:59.676433 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 276/558] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:15:59 2022] GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:16:00.091993 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-46815da5-3431-446c-8dac-683e3fe531de tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:00.092601 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-46815da5-3431-446c-8dac-683e3fe531de tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:00.098625 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-46815da5-3431-446c-8dac-683e3fe531de tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:00.099104 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-46815da5-3431-446c-8dac-683e3fe531de tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:00.099535 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-46815da5-3431-446c-8dac-683e3fe531de tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:00.100218 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-46815da5-3431-446c-8dac-683e3fe531de tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:00.100670 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-46815da5-3431-446c-8dac-683e3fe531de tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:00.101120 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-46815da5-3431-446c-8dac-683e3fe531de tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:00.227938 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-46815da5-3431-446c-8dac-683e3fe531de tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:00.236496 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-46815da5-3431-446c-8dac-683e3fe531de tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1372 microversion: 2.1 time: 0.148508 Aug 31 19:16:00.237048 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 283/559] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:00 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1372 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:16:00.412753 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-88024a50-2948-46be-a316-1f6dd9ef09d3 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:00.413389 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-88024a50-2948-46be-a316-1f6dd9ef09d3 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:00.419972 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-88024a50-2948-46be-a316-1f6dd9ef09d3 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:00.420451 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-88024a50-2948-46be-a316-1f6dd9ef09d3 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:00.420881 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-88024a50-2948-46be-a316-1f6dd9ef09d3 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:00.421596 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-88024a50-2948-46be-a316-1f6dd9ef09d3 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:00.422046 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-88024a50-2948-46be-a316-1f6dd9ef09d3 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:00.422460 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-88024a50-2948-46be-a316-1f6dd9ef09d3 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:00.550819 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-88024a50-2948-46be-a316-1f6dd9ef09d3 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:00.558389 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-88024a50-2948-46be-a316-1f6dd9ef09d3 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1259 microversion: 2.1 time: 0.149522 Aug 31 19:16:00.558941 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 277/560] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:00 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:16:00.684076 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-9add0e1b-72f6-4b0f-8cd2-b0cfaeb0910f tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:00.684782 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-9add0e1b-72f6-4b0f-8cd2-b0cfaeb0910f tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: 99d78918-36ca-462d-9037-ea8b81fbfc2e] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:00.690707 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9add0e1b-72f6-4b0f-8cd2-b0cfaeb0910f tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:00.691274 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9add0e1b-72f6-4b0f-8cd2-b0cfaeb0910f tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:00.691826 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9add0e1b-72f6-4b0f-8cd2-b0cfaeb0910f tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:00.692558 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9add0e1b-72f6-4b0f-8cd2-b0cfaeb0910f tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:00.693216 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9add0e1b-72f6-4b0f-8cd2-b0cfaeb0910f tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:00.693891 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9add0e1b-72f6-4b0f-8cd2-b0cfaeb0910f tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:00.698806 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=100 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:16:00.837107 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-9add0e1b-72f6-4b0f-8cd2-b0cfaeb0910f tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b8da543ad543bb95881450e4f9b585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5f61674804f93bd2127fc76919bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:00.845963 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-9add0e1b-72f6-4b0f-8cd2-b0cfaeb0910f tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] 10.222.0.65 "GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e" status: 200 len: 1318 microversion: 2.1 time: 0.166065 Aug 31 19:16:00.846523 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 284/561] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:00 2022] GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:16:01.256141 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-d2096032-7753-4efc-a2a8-77f0a0f61d76 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:01.256827 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-d2096032-7753-4efc-a2a8-77f0a0f61d76 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:01.263615 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d2096032-7753-4efc-a2a8-77f0a0f61d76 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:01.264211 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d2096032-7753-4efc-a2a8-77f0a0f61d76 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:01.264676 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d2096032-7753-4efc-a2a8-77f0a0f61d76 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:01.265418 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d2096032-7753-4efc-a2a8-77f0a0f61d76 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:01.265873 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d2096032-7753-4efc-a2a8-77f0a0f61d76 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:01.266481 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d2096032-7753-4efc-a2a8-77f0a0f61d76 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:01.397260 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-d2096032-7753-4efc-a2a8-77f0a0f61d76 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:01.404903 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-d2096032-7753-4efc-a2a8-77f0a0f61d76 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1372 microversion: 2.1 time: 0.152792 Aug 31 19:16:01.405498 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 278/562] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:01 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:16:01.579128 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-46e0dba2-eda1-449c-bebb-c0fa422be6dd tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:01.579653 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-46e0dba2-eda1-449c-bebb-c0fa422be6dd tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:01.585580 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-46e0dba2-eda1-449c-bebb-c0fa422be6dd tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:01.586058 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-46e0dba2-eda1-449c-bebb-c0fa422be6dd tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:01.586482 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-46e0dba2-eda1-449c-bebb-c0fa422be6dd tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:01.587159 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-46e0dba2-eda1-449c-bebb-c0fa422be6dd tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:01.587613 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-46e0dba2-eda1-449c-bebb-c0fa422be6dd tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:01.588032 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-46e0dba2-eda1-449c-bebb-c0fa422be6dd tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:01.720759 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-46e0dba2-eda1-449c-bebb-c0fa422be6dd tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:01.728278 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-46e0dba2-eda1-449c-bebb-c0fa422be6dd tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1259 microversion: 2.1 time: 0.153173 Aug 31 19:16:01.728828 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 285/563] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:01 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:16:01.866492 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-307fa666-d68e-45c2-86c6-b9a1ce651fdb tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:01.867100 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-307fa666-d68e-45c2-86c6-b9a1ce651fdb tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: 99d78918-36ca-462d-9037-ea8b81fbfc2e] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:01.873495 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-307fa666-d68e-45c2-86c6-b9a1ce651fdb tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:01.873975 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-307fa666-d68e-45c2-86c6-b9a1ce651fdb tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:01.874405 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-307fa666-d68e-45c2-86c6-b9a1ce651fdb tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:01.875089 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-307fa666-d68e-45c2-86c6-b9a1ce651fdb tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:01.875539 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-307fa666-d68e-45c2-86c6-b9a1ce651fdb tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:01.875960 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-307fa666-d68e-45c2-86c6-b9a1ce651fdb tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:02.002719 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-307fa666-d68e-45c2-86c6-b9a1ce651fdb tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b8da543ad543bb95881450e4f9b585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5f61674804f93bd2127fc76919bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:02.010346 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-307fa666-d68e-45c2-86c6-b9a1ce651fdb tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] 10.222.0.65 "GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e" status: 200 len: 1318 microversion: 2.1 time: 0.147635 Aug 31 19:16:02.010906 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 279/564] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:01 2022] GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:16:02.425347 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d1f1f62c-035d-48be-aa7b-ec010eb35337 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:02.425955 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d1f1f62c-035d-48be-aa7b-ec010eb35337 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:02.431897 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d1f1f62c-035d-48be-aa7b-ec010eb35337 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:02.432378 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d1f1f62c-035d-48be-aa7b-ec010eb35337 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:02.432807 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d1f1f62c-035d-48be-aa7b-ec010eb35337 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:02.433588 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d1f1f62c-035d-48be-aa7b-ec010eb35337 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:02.434044 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d1f1f62c-035d-48be-aa7b-ec010eb35337 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:02.434463 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d1f1f62c-035d-48be-aa7b-ec010eb35337 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:02.560210 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-d1f1f62c-035d-48be-aa7b-ec010eb35337 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:02.567761 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-d1f1f62c-035d-48be-aa7b-ec010eb35337 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1372 microversion: 2.1 time: 0.146249 Aug 31 19:16:02.568326 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 286/565] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:02 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1372 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:16:02.750638 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-6ae4aedd-3a36-4130-bb80-43c5d2caedad tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:02.751243 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-6ae4aedd-3a36-4130-bb80-43c5d2caedad tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:02.757355 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6ae4aedd-3a36-4130-bb80-43c5d2caedad tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:02.757839 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6ae4aedd-3a36-4130-bb80-43c5d2caedad tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:02.758267 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6ae4aedd-3a36-4130-bb80-43c5d2caedad tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:02.758948 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6ae4aedd-3a36-4130-bb80-43c5d2caedad tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:02.759392 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6ae4aedd-3a36-4130-bb80-43c5d2caedad tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:02.759809 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6ae4aedd-3a36-4130-bb80-43c5d2caedad tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:02.888401 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-6ae4aedd-3a36-4130-bb80-43c5d2caedad tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:02.896141 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-6ae4aedd-3a36-4130-bb80-43c5d2caedad tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1259 microversion: 2.1 time: 0.149873 Aug 31 19:16:02.896691 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 280/566] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:02 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:16:03.030972 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-1665ea79-4089-4881-bf26-27156b188fa0 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:03.031529 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-1665ea79-4089-4881-bf26-27156b188fa0 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: 99d78918-36ca-462d-9037-ea8b81fbfc2e] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:03.037449 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1665ea79-4089-4881-bf26-27156b188fa0 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:03.037938 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1665ea79-4089-4881-bf26-27156b188fa0 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:03.038370 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1665ea79-4089-4881-bf26-27156b188fa0 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:03.039060 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1665ea79-4089-4881-bf26-27156b188fa0 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:03.039518 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1665ea79-4089-4881-bf26-27156b188fa0 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:03.039941 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1665ea79-4089-4881-bf26-27156b188fa0 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:03.169848 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1665ea79-4089-4881-bf26-27156b188fa0 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b8da543ad543bb95881450e4f9b585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5f61674804f93bd2127fc76919bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:03.177467 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-1665ea79-4089-4881-bf26-27156b188fa0 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] 10.222.0.65 "GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e" status: 200 len: 1318 microversion: 2.1 time: 0.150384 Aug 31 19:16:03.178039 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 287/567] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:03 2022] GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:16:03.589017 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-e2c0ba51-1e4a-4f19-8dd4-064334bb1b73 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:03.589596 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-e2c0ba51-1e4a-4f19-8dd4-064334bb1b73 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:03.596122 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e2c0ba51-1e4a-4f19-8dd4-064334bb1b73 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:03.596600 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e2c0ba51-1e4a-4f19-8dd4-064334bb1b73 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:03.597027 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e2c0ba51-1e4a-4f19-8dd4-064334bb1b73 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:03.597732 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e2c0ba51-1e4a-4f19-8dd4-064334bb1b73 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:03.598181 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e2c0ba51-1e4a-4f19-8dd4-064334bb1b73 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:03.598597 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e2c0ba51-1e4a-4f19-8dd4-064334bb1b73 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:03.602524 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=100 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:16:03.731733 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-e2c0ba51-1e4a-4f19-8dd4-064334bb1b73 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:03.739337 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-e2c0ba51-1e4a-4f19-8dd4-064334bb1b73 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1372 microversion: 2.1 time: 0.154375 Aug 31 19:16:03.739891 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 281/568] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:03 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:16:03.917109 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d8a363c2-1b3d-4565-bfd2-b9c8410760b1 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:03.917746 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d8a363c2-1b3d-4565-bfd2-b9c8410760b1 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:03.923909 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d8a363c2-1b3d-4565-bfd2-b9c8410760b1 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:03.924390 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d8a363c2-1b3d-4565-bfd2-b9c8410760b1 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:03.924818 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d8a363c2-1b3d-4565-bfd2-b9c8410760b1 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:03.925544 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d8a363c2-1b3d-4565-bfd2-b9c8410760b1 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:03.925992 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d8a363c2-1b3d-4565-bfd2-b9c8410760b1 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:03.926410 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d8a363c2-1b3d-4565-bfd2-b9c8410760b1 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:04.056330 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-d8a363c2-1b3d-4565-bfd2-b9c8410760b1 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:04.064700 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-d8a363c2-1b3d-4565-bfd2-b9c8410760b1 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1259 microversion: 2.1 time: 0.151640 Aug 31 19:16:04.065281 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 288/569] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:03 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:16:04.199070 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-ced9afb7-e681-4f36-972d-5fc00474e922 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:04.200345 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-ced9afb7-e681-4f36-972d-5fc00474e922 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: 99d78918-36ca-462d-9037-ea8b81fbfc2e] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:04.206714 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ced9afb7-e681-4f36-972d-5fc00474e922 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:04.207193 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ced9afb7-e681-4f36-972d-5fc00474e922 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:04.207621 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ced9afb7-e681-4f36-972d-5fc00474e922 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:04.208298 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ced9afb7-e681-4f36-972d-5fc00474e922 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:04.208745 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ced9afb7-e681-4f36-972d-5fc00474e922 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:04.209279 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ced9afb7-e681-4f36-972d-5fc00474e922 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:04.338561 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-ced9afb7-e681-4f36-972d-5fc00474e922 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b8da543ad543bb95881450e4f9b585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5f61674804f93bd2127fc76919bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:04.346443 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-ced9afb7-e681-4f36-972d-5fc00474e922 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] 10.222.0.65 "GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e" status: 200 len: 1318 microversion: 2.1 time: 0.151360 Aug 31 19:16:04.347020 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 282/570] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:04 2022] GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:16:04.759446 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-bd0b9cea-e7b2-4f3b-838e-18282cfef844 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:04.759988 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-bd0b9cea-e7b2-4f3b-838e-18282cfef844 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:04.765905 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bd0b9cea-e7b2-4f3b-838e-18282cfef844 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:04.766385 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bd0b9cea-e7b2-4f3b-838e-18282cfef844 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:04.766819 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bd0b9cea-e7b2-4f3b-838e-18282cfef844 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:04.767491 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bd0b9cea-e7b2-4f3b-838e-18282cfef844 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:04.767937 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bd0b9cea-e7b2-4f3b-838e-18282cfef844 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:04.768356 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bd0b9cea-e7b2-4f3b-838e-18282cfef844 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:04.896542 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-bd0b9cea-e7b2-4f3b-838e-18282cfef844 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:04.904561 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-bd0b9cea-e7b2-4f3b-838e-18282cfef844 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1372 microversion: 2.1 time: 0.148946 Aug 31 19:16:04.905120 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 289/571] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:04 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1372 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:16:05.085946 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-44158842-8d63-4518-99c1-9890e9098462 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:05.086565 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-44158842-8d63-4518-99c1-9890e9098462 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:05.093332 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-44158842-8d63-4518-99c1-9890e9098462 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:05.093816 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-44158842-8d63-4518-99c1-9890e9098462 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:05.094248 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-44158842-8d63-4518-99c1-9890e9098462 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:05.094938 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-44158842-8d63-4518-99c1-9890e9098462 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:05.095390 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-44158842-8d63-4518-99c1-9890e9098462 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:05.095808 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-44158842-8d63-4518-99c1-9890e9098462 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:05.228599 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-44158842-8d63-4518-99c1-9890e9098462 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:05.236468 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-44158842-8d63-4518-99c1-9890e9098462 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1259 microversion: 2.1 time: 0.154396 Aug 31 19:16:05.237028 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 283/572] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:05 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:16:05.367520 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-596a24b6-7dfd-40e0-9f4c-bfd0b062c5f0 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:05.368132 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-596a24b6-7dfd-40e0-9f4c-bfd0b062c5f0 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: 99d78918-36ca-462d-9037-ea8b81fbfc2e] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:05.374174 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-596a24b6-7dfd-40e0-9f4c-bfd0b062c5f0 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:05.374667 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-596a24b6-7dfd-40e0-9f4c-bfd0b062c5f0 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:05.375102 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-596a24b6-7dfd-40e0-9f4c-bfd0b062c5f0 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:05.375820 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-596a24b6-7dfd-40e0-9f4c-bfd0b062c5f0 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:05.376275 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-596a24b6-7dfd-40e0-9f4c-bfd0b062c5f0 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:05.376693 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-596a24b6-7dfd-40e0-9f4c-bfd0b062c5f0 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:05.872772 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-596a24b6-7dfd-40e0-9f4c-bfd0b062c5f0 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b8da543ad543bb95881450e4f9b585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5f61674804f93bd2127fc76919bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:05.880370 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-596a24b6-7dfd-40e0-9f4c-bfd0b062c5f0 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] 10.222.0.65 "GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e" status: 200 len: 1318 microversion: 2.1 time: 0.516563 Aug 31 19:16:05.887308 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 290/573] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:05 2022] GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e => generated 1318 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:16:05.924345 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-f1f3e3db-a836-4357-9173-7a30a0626a7b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:05.924949 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-f1f3e3db-a836-4357-9173-7a30a0626a7b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:05.930986 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f1f3e3db-a836-4357-9173-7a30a0626a7b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:05.931565 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f1f3e3db-a836-4357-9173-7a30a0626a7b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:05.932021 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f1f3e3db-a836-4357-9173-7a30a0626a7b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:05.932609 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f1f3e3db-a836-4357-9173-7a30a0626a7b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:05.933240 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f1f3e3db-a836-4357-9173-7a30a0626a7b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:05.933843 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f1f3e3db-a836-4357-9173-7a30a0626a7b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:06.079940 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-f1f3e3db-a836-4357-9173-7a30a0626a7b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:06.087827 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-f1f3e3db-a836-4357-9173-7a30a0626a7b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1372 microversion: 2.1 time: 0.167498 Aug 31 19:16:06.088390 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 284/574] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:05 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1372 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:16:06.257521 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-2c9f0885-ebf4-49b8-8a36-46ec434a3d96 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:06.258204 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-2c9f0885-ebf4-49b8-8a36-46ec434a3d96 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:06.264104 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2c9f0885-ebf4-49b8-8a36-46ec434a3d96 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:06.264589 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2c9f0885-ebf4-49b8-8a36-46ec434a3d96 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:06.265020 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2c9f0885-ebf4-49b8-8a36-46ec434a3d96 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:06.269537 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2c9f0885-ebf4-49b8-8a36-46ec434a3d96 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:06.270054 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2c9f0885-ebf4-49b8-8a36-46ec434a3d96 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:06.270494 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2c9f0885-ebf4-49b8-8a36-46ec434a3d96 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:06.404903 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-2c9f0885-ebf4-49b8-8a36-46ec434a3d96 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:06.413032 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-2c9f0885-ebf4-49b8-8a36-46ec434a3d96 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1259 microversion: 2.1 time: 0.159262 Aug 31 19:16:06.420103 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 291/575] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:06 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:16:06.900794 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-760e2128-25d5-4324-96b8-492f7910e338 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:06.901428 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-760e2128-25d5-4324-96b8-492f7910e338 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: 99d78918-36ca-462d-9037-ea8b81fbfc2e] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:06.908337 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-760e2128-25d5-4324-96b8-492f7910e338 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:06.908822 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-760e2128-25d5-4324-96b8-492f7910e338 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:06.909266 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-760e2128-25d5-4324-96b8-492f7910e338 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:06.909949 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-760e2128-25d5-4324-96b8-492f7910e338 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:06.910401 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-760e2128-25d5-4324-96b8-492f7910e338 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:06.910815 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-760e2128-25d5-4324-96b8-492f7910e338 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:07.041840 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-760e2128-25d5-4324-96b8-492f7910e338 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b8da543ad543bb95881450e4f9b585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5f61674804f93bd2127fc76919bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:07.049521 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-760e2128-25d5-4324-96b8-492f7910e338 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] 10.222.0.65 "GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e" status: 200 len: 1318 microversion: 2.1 time: 0.152539 Aug 31 19:16:07.050071 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 285/576] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:06 2022] GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:16:07.109519 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-ca66feb0-8e5e-4411-8629-d89e3678a3f3 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:07.110443 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-ca66feb0-8e5e-4411-8629-d89e3678a3f3 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:07.116692 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ca66feb0-8e5e-4411-8629-d89e3678a3f3 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:07.117324 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ca66feb0-8e5e-4411-8629-d89e3678a3f3 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:07.117899 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ca66feb0-8e5e-4411-8629-d89e3678a3f3 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:07.118586 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ca66feb0-8e5e-4411-8629-d89e3678a3f3 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:07.119036 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ca66feb0-8e5e-4411-8629-d89e3678a3f3 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:07.119451 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ca66feb0-8e5e-4411-8629-d89e3678a3f3 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:07.254753 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-ca66feb0-8e5e-4411-8629-d89e3678a3f3 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:07.263193 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-ca66feb0-8e5e-4411-8629-d89e3678a3f3 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1372 microversion: 2.1 time: 0.157422 Aug 31 19:16:07.263747 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 292/577] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:07 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:16:07.434598 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-31c807f8-4a2b-4c0d-8515-da1c631b40dd tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:07.435223 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-31c807f8-4a2b-4c0d-8515-da1c631b40dd tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:07.441172 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-31c807f8-4a2b-4c0d-8515-da1c631b40dd tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:07.441780 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-31c807f8-4a2b-4c0d-8515-da1c631b40dd tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:07.442206 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-31c807f8-4a2b-4c0d-8515-da1c631b40dd tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:07.442882 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-31c807f8-4a2b-4c0d-8515-da1c631b40dd tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:07.443336 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-31c807f8-4a2b-4c0d-8515-da1c631b40dd tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:07.443743 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-31c807f8-4a2b-4c0d-8515-da1c631b40dd tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:07.575324 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-31c807f8-4a2b-4c0d-8515-da1c631b40dd tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:07.583106 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-31c807f8-4a2b-4c0d-8515-da1c631b40dd tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1259 microversion: 2.1 time: 0.152933 Aug 31 19:16:07.583659 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 286/578] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:07 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:16:08.070578 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-1831bafe-d475-4419-b58d-44d95c206b79 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:08.071175 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-1831bafe-d475-4419-b58d-44d95c206b79 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: 99d78918-36ca-462d-9037-ea8b81fbfc2e] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:08.082191 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1831bafe-d475-4419-b58d-44d95c206b79 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:08.082702 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1831bafe-d475-4419-b58d-44d95c206b79 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:08.083149 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1831bafe-d475-4419-b58d-44d95c206b79 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:08.083843 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1831bafe-d475-4419-b58d-44d95c206b79 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:08.084326 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1831bafe-d475-4419-b58d-44d95c206b79 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:08.084750 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1831bafe-d475-4419-b58d-44d95c206b79 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:08.225815 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1831bafe-d475-4419-b58d-44d95c206b79 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b8da543ad543bb95881450e4f9b585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5f61674804f93bd2127fc76919bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:08.233656 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-1831bafe-d475-4419-b58d-44d95c206b79 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] 10.222.0.65 "GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e" status: 200 len: 1318 microversion: 2.1 time: 0.167007 Aug 31 19:16:08.234208 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 293/579] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:08 2022] GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:16:08.283980 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-183334f8-2a5b-40df-aea6-6ff4dfff7fe9 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:08.284589 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-183334f8-2a5b-40df-aea6-6ff4dfff7fe9 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:08.291092 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-183334f8-2a5b-40df-aea6-6ff4dfff7fe9 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:08.291574 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-183334f8-2a5b-40df-aea6-6ff4dfff7fe9 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:08.292012 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-183334f8-2a5b-40df-aea6-6ff4dfff7fe9 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:08.292699 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-183334f8-2a5b-40df-aea6-6ff4dfff7fe9 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:08.293149 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-183334f8-2a5b-40df-aea6-6ff4dfff7fe9 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:08.293614 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-183334f8-2a5b-40df-aea6-6ff4dfff7fe9 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:08.425627 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-183334f8-2a5b-40df-aea6-6ff4dfff7fe9 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:08.433973 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-183334f8-2a5b-40df-aea6-6ff4dfff7fe9 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1372 microversion: 2.1 time: 0.153822 Aug 31 19:16:08.434616 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 287/580] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:08 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:16:08.603463 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-04584d64-5690-472f-9695-55910f29e63e tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:08.604075 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-04584d64-5690-472f-9695-55910f29e63e tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:08.610400 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-04584d64-5690-472f-9695-55910f29e63e tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:08.610884 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-04584d64-5690-472f-9695-55910f29e63e tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:08.611347 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-04584d64-5690-472f-9695-55910f29e63e tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:08.612033 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-04584d64-5690-472f-9695-55910f29e63e tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:08.612488 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-04584d64-5690-472f-9695-55910f29e63e tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:08.612938 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-04584d64-5690-472f-9695-55910f29e63e tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:08.744297 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-04584d64-5690-472f-9695-55910f29e63e tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:08.752757 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-04584d64-5690-472f-9695-55910f29e63e tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1259 microversion: 2.1 time: 0.153071 Aug 31 19:16:08.753368 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 294/581] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:08 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:16:09.254579 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-db30bb99-07fa-42fe-89ff-bcba533732d1 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:09.255174 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-db30bb99-07fa-42fe-89ff-bcba533732d1 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: 99d78918-36ca-462d-9037-ea8b81fbfc2e] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:09.257001 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:16:09.262288 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-db30bb99-07fa-42fe-89ff-bcba533732d1 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:09.262760 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-db30bb99-07fa-42fe-89ff-bcba533732d1 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:09.263183 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-db30bb99-07fa-42fe-89ff-bcba533732d1 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:09.263888 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-db30bb99-07fa-42fe-89ff-bcba533732d1 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:09.264327 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-db30bb99-07fa-42fe-89ff-bcba533732d1 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:09.264735 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-db30bb99-07fa-42fe-89ff-bcba533732d1 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:09.394791 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-db30bb99-07fa-42fe-89ff-bcba533732d1 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b8da543ad543bb95881450e4f9b585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5f61674804f93bd2127fc76919bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:09.402259 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-db30bb99-07fa-42fe-89ff-bcba533732d1 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] 10.222.0.65 "GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e" status: 200 len: 1318 microversion: 2.1 time: 0.151484 Aug 31 19:16:09.403305 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 288/582] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:09 2022] GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:16:09.455436 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-1633c7fc-34fa-434a-a0f8-7f336cd7659b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:09.455975 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-1633c7fc-34fa-434a-a0f8-7f336cd7659b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:09.461928 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1633c7fc-34fa-434a-a0f8-7f336cd7659b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:09.462407 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1633c7fc-34fa-434a-a0f8-7f336cd7659b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:09.462836 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1633c7fc-34fa-434a-a0f8-7f336cd7659b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:09.463516 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1633c7fc-34fa-434a-a0f8-7f336cd7659b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:09.463963 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1633c7fc-34fa-434a-a0f8-7f336cd7659b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:09.464382 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1633c7fc-34fa-434a-a0f8-7f336cd7659b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:09.595373 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1633c7fc-34fa-434a-a0f8-7f336cd7659b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:09.603544 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-1633c7fc-34fa-434a-a0f8-7f336cd7659b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1372 microversion: 2.1 time: 0.151778 Aug 31 19:16:09.603908 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 295/583] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:09 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1372 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:16:09.774486 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-a7c1d235-340c-40f6-8de6-93ffa2957679 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:09.775115 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-a7c1d235-340c-40f6-8de6-93ffa2957679 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:09.791990 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a7c1d235-340c-40f6-8de6-93ffa2957679 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:09.792518 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a7c1d235-340c-40f6-8de6-93ffa2957679 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:09.792959 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a7c1d235-340c-40f6-8de6-93ffa2957679 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:09.793862 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a7c1d235-340c-40f6-8de6-93ffa2957679 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:09.794320 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a7c1d235-340c-40f6-8de6-93ffa2957679 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:09.794737 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a7c1d235-340c-40f6-8de6-93ffa2957679 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:09.954742 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-a7c1d235-340c-40f6-8de6-93ffa2957679 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:09.962513 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-a7c1d235-340c-40f6-8de6-93ffa2957679 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1259 microversion: 2.1 time: 0.192070 Aug 31 19:16:09.963078 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 289/584] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:09 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1259 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:16:10.424048 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d0cbd4ed-17d4-43d4-8c25-bed601730cf5 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:10.424629 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d0cbd4ed-17d4-43d4-8c25-bed601730cf5 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: 99d78918-36ca-462d-9037-ea8b81fbfc2e] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:10.430597 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d0cbd4ed-17d4-43d4-8c25-bed601730cf5 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:10.431115 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d0cbd4ed-17d4-43d4-8c25-bed601730cf5 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:10.431548 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d0cbd4ed-17d4-43d4-8c25-bed601730cf5 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:10.432228 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d0cbd4ed-17d4-43d4-8c25-bed601730cf5 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:10.432680 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d0cbd4ed-17d4-43d4-8c25-bed601730cf5 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:10.433099 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d0cbd4ed-17d4-43d4-8c25-bed601730cf5 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:10.560825 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-d0cbd4ed-17d4-43d4-8c25-bed601730cf5 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b8da543ad543bb95881450e4f9b585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5f61674804f93bd2127fc76919bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:10.568530 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-d0cbd4ed-17d4-43d4-8c25-bed601730cf5 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] 10.222.0.65 "GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e" status: 200 len: 1318 microversion: 2.1 time: 0.148451 Aug 31 19:16:10.569083 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 296/585] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:10 2022] GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:16:10.623967 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-8e268522-078b-4b2f-9a37-fa7a17db4d00 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:10.624568 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-8e268522-078b-4b2f-9a37-fa7a17db4d00 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:10.631055 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8e268522-078b-4b2f-9a37-fa7a17db4d00 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:10.631608 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8e268522-078b-4b2f-9a37-fa7a17db4d00 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:10.632444 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8e268522-078b-4b2f-9a37-fa7a17db4d00 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:10.632996 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8e268522-078b-4b2f-9a37-fa7a17db4d00 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:10.633514 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8e268522-078b-4b2f-9a37-fa7a17db4d00 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:10.633971 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8e268522-078b-4b2f-9a37-fa7a17db4d00 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:10.763001 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-8e268522-078b-4b2f-9a37-fa7a17db4d00 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:10.770524 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-8e268522-078b-4b2f-9a37-fa7a17db4d00 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1372 microversion: 2.1 time: 0.150981 Aug 31 19:16:10.771100 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 290/586] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:10 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:16:10.984305 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-471e3bd1-e1b5-4f27-ae01-c368fb1b3b42 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:10.984804 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-471e3bd1-e1b5-4f27-ae01-c368fb1b3b42 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:10.990713 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-471e3bd1-e1b5-4f27-ae01-c368fb1b3b42 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:10.991211 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-471e3bd1-e1b5-4f27-ae01-c368fb1b3b42 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:10.991633 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-471e3bd1-e1b5-4f27-ae01-c368fb1b3b42 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:10.992303 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-471e3bd1-e1b5-4f27-ae01-c368fb1b3b42 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:10.992744 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-471e3bd1-e1b5-4f27-ae01-c368fb1b3b42 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:10.993177 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-471e3bd1-e1b5-4f27-ae01-c368fb1b3b42 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:11.126611 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-471e3bd1-e1b5-4f27-ae01-c368fb1b3b42 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:11.134362 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-471e3bd1-e1b5-4f27-ae01-c368fb1b3b42 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1259 microversion: 2.1 time: 0.154821 Aug 31 19:16:11.134917 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 297/587] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:10 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:16:11.589222 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-4033d370-03b7-4896-830c-d2c5e50682e7 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:11.589981 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-4033d370-03b7-4896-830c-d2c5e50682e7 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: 99d78918-36ca-462d-9037-ea8b81fbfc2e] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:11.596057 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4033d370-03b7-4896-830c-d2c5e50682e7 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:11.596542 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4033d370-03b7-4896-830c-d2c5e50682e7 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:11.596972 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4033d370-03b7-4896-830c-d2c5e50682e7 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:11.597682 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4033d370-03b7-4896-830c-d2c5e50682e7 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:11.598310 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4033d370-03b7-4896-830c-d2c5e50682e7 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:11.598745 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4033d370-03b7-4896-830c-d2c5e50682e7 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:11.739677 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-4033d370-03b7-4896-830c-d2c5e50682e7 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b8da543ad543bb95881450e4f9b585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5f61674804f93bd2127fc76919bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:11.748105 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-4033d370-03b7-4896-830c-d2c5e50682e7 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] 10.222.0.65 "GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e" status: 200 len: 1318 microversion: 2.1 time: 0.163140 Aug 31 19:16:11.748751 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 291/588] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:11 2022] GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:16:11.791327 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-a8eac0e8-f82f-47ec-84d6-256b15baa767 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:11.791855 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-a8eac0e8-f82f-47ec-84d6-256b15baa767 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:11.797749 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a8eac0e8-f82f-47ec-84d6-256b15baa767 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:11.798224 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a8eac0e8-f82f-47ec-84d6-256b15baa767 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:11.798647 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a8eac0e8-f82f-47ec-84d6-256b15baa767 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:11.799316 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a8eac0e8-f82f-47ec-84d6-256b15baa767 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:11.799760 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a8eac0e8-f82f-47ec-84d6-256b15baa767 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:11.800182 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a8eac0e8-f82f-47ec-84d6-256b15baa767 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:11.926786 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-a8eac0e8-f82f-47ec-84d6-256b15baa767 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:11.934321 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-a8eac0e8-f82f-47ec-84d6-256b15baa767 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1372 microversion: 2.1 time: 0.146802 Aug 31 19:16:11.935496 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 298/589] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:11 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1372 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:16:12.155601 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-95058523-831f-4fbc-ba48-b165b43d812f tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:12.156124 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-95058523-831f-4fbc-ba48-b165b43d812f tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:12.162520 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-95058523-831f-4fbc-ba48-b165b43d812f tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:12.163078 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-95058523-831f-4fbc-ba48-b165b43d812f tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:12.163510 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-95058523-831f-4fbc-ba48-b165b43d812f tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:12.164192 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-95058523-831f-4fbc-ba48-b165b43d812f tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:12.164638 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-95058523-831f-4fbc-ba48-b165b43d812f tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:12.165054 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-95058523-831f-4fbc-ba48-b165b43d812f tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:12.296616 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-95058523-831f-4fbc-ba48-b165b43d812f tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:12.304653 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-95058523-831f-4fbc-ba48-b165b43d812f tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1259 microversion: 2.1 time: 0.152608 Aug 31 19:16:12.305314 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 292/590] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:12 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:16:12.770165 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-a4262ba2-38a9-4f5b-90ef-217665b2ae12 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:12.770874 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-a4262ba2-38a9-4f5b-90ef-217665b2ae12 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: 99d78918-36ca-462d-9037-ea8b81fbfc2e] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:12.777705 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a4262ba2-38a9-4f5b-90ef-217665b2ae12 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:12.778406 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a4262ba2-38a9-4f5b-90ef-217665b2ae12 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:12.778843 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a4262ba2-38a9-4f5b-90ef-217665b2ae12 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:12.779587 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a4262ba2-38a9-4f5b-90ef-217665b2ae12 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:12.780563 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a4262ba2-38a9-4f5b-90ef-217665b2ae12 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:12.780981 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a4262ba2-38a9-4f5b-90ef-217665b2ae12 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:12.964840 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-a4262ba2-38a9-4f5b-90ef-217665b2ae12 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b8da543ad543bb95881450e4f9b585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5f61674804f93bd2127fc76919bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:12.974283 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-b489833d-7ed0-46a8-a77c-2896fe7b5c28 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:12.975924 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-b489833d-7ed0-46a8-a77c-2896fe7b5c28 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:12.989240 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b489833d-7ed0-46a8-a77c-2896fe7b5c28 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:12.991085 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-a4262ba2-38a9-4f5b-90ef-217665b2ae12 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] 10.222.0.65 "GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e" status: 200 len: 1318 microversion: 2.1 time: 0.225007 Aug 31 19:16:12.992116 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 299/591] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:12 2022] GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:16:12.992684 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b489833d-7ed0-46a8-a77c-2896fe7b5c28 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:12.993255 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b489833d-7ed0-46a8-a77c-2896fe7b5c28 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:12.994372 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b489833d-7ed0-46a8-a77c-2896fe7b5c28 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:12.994924 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b489833d-7ed0-46a8-a77c-2896fe7b5c28 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:12.995442 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b489833d-7ed0-46a8-a77c-2896fe7b5c28 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:13.165396 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-b489833d-7ed0-46a8-a77c-2896fe7b5c28 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:13.175764 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-b489833d-7ed0-46a8-a77c-2896fe7b5c28 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1372 microversion: 2.1 time: 0.224168 Aug 31 19:16:13.176962 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 293/592] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:12 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1372 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:16:13.327346 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e1268386-2beb-4497-8266-a4d2623c0dbb tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:13.328077 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-e1268386-2beb-4497-8266-a4d2623c0dbb tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:13.334467 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e1268386-2beb-4497-8266-a4d2623c0dbb tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:13.335194 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e1268386-2beb-4497-8266-a4d2623c0dbb tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:13.335727 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e1268386-2beb-4497-8266-a4d2623c0dbb tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:13.337130 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e1268386-2beb-4497-8266-a4d2623c0dbb tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:13.337467 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e1268386-2beb-4497-8266-a4d2623c0dbb tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:13.338056 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e1268386-2beb-4497-8266-a4d2623c0dbb tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:13.518934 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e1268386-2beb-4497-8266-a4d2623c0dbb tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:13.524381 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=100 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:16:13.536144 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-e1268386-2beb-4497-8266-a4d2623c0dbb tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1259 microversion: 2.1 time: 0.213352 Aug 31 19:16:13.537981 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 300/593] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:13 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1259 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:16:14.013365 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-ea6162ef-92be-4e68-8090-81617ffb4533 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:14.016352 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-ea6162ef-92be-4e68-8090-81617ffb4533 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: 99d78918-36ca-462d-9037-ea8b81fbfc2e] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:14.027162 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ea6162ef-92be-4e68-8090-81617ffb4533 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:14.027642 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ea6162ef-92be-4e68-8090-81617ffb4533 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:14.029751 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ea6162ef-92be-4e68-8090-81617ffb4533 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:14.030457 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ea6162ef-92be-4e68-8090-81617ffb4533 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:14.031083 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ea6162ef-92be-4e68-8090-81617ffb4533 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:14.031500 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ea6162ef-92be-4e68-8090-81617ffb4533 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:14.237709 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-33766b0d-5ba0-472b-86f5-aa40e6eeb04b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:14.237709 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-33766b0d-5ba0-472b-86f5-aa40e6eeb04b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:14.237709 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-33766b0d-5ba0-472b-86f5-aa40e6eeb04b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:14.237709 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-33766b0d-5ba0-472b-86f5-aa40e6eeb04b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:14.238985 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-33766b0d-5ba0-472b-86f5-aa40e6eeb04b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:14.238985 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-33766b0d-5ba0-472b-86f5-aa40e6eeb04b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:14.238985 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-33766b0d-5ba0-472b-86f5-aa40e6eeb04b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:14.238985 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-33766b0d-5ba0-472b-86f5-aa40e6eeb04b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:14.303305 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-ea6162ef-92be-4e68-8090-81617ffb4533 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b8da543ad543bb95881450e4f9b585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5f61674804f93bd2127fc76919bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:14.317386 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-ea6162ef-92be-4e68-8090-81617ffb4533 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] 10.222.0.65 "GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e" status: 200 len: 1318 microversion: 2.1 time: 0.308182 Aug 31 19:16:14.332686 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 294/594] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:14 2022] GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e => generated 1318 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:16:14.478595 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-33766b0d-5ba0-472b-86f5-aa40e6eeb04b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:14.492084 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-33766b0d-5ba0-472b-86f5-aa40e6eeb04b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1372 microversion: 2.1 time: 0.286800 Aug 31 19:16:14.505214 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 301/595] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:14 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1372 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:16:14.560494 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-f07e8e2a-06c4-47ca-958c-ac63e9ce94e2 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:14.561513 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-f07e8e2a-06c4-47ca-958c-ac63e9ce94e2 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:14.570943 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f07e8e2a-06c4-47ca-958c-ac63e9ce94e2 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:14.571475 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f07e8e2a-06c4-47ca-958c-ac63e9ce94e2 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:14.571909 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f07e8e2a-06c4-47ca-958c-ac63e9ce94e2 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:14.572758 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f07e8e2a-06c4-47ca-958c-ac63e9ce94e2 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:14.573224 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f07e8e2a-06c4-47ca-958c-ac63e9ce94e2 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:14.573652 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f07e8e2a-06c4-47ca-958c-ac63e9ce94e2 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:14.860428 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-f07e8e2a-06c4-47ca-958c-ac63e9ce94e2 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:14.869026 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-f07e8e2a-06c4-47ca-958c-ac63e9ce94e2 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1259 microversion: 2.1 time: 0.312476 Aug 31 19:16:14.873315 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 295/596] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:14 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1259 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:16:15.339854 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-2eb22e64-b5fc-4b6b-a54f-9600c386b047 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:15.340444 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-2eb22e64-b5fc-4b6b-a54f-9600c386b047 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: 99d78918-36ca-462d-9037-ea8b81fbfc2e] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:15.348069 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2eb22e64-b5fc-4b6b-a54f-9600c386b047 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:15.349411 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2eb22e64-b5fc-4b6b-a54f-9600c386b047 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:15.349836 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2eb22e64-b5fc-4b6b-a54f-9600c386b047 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:15.351119 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2eb22e64-b5fc-4b6b-a54f-9600c386b047 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:15.351577 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2eb22e64-b5fc-4b6b-a54f-9600c386b047 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:15.352464 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2eb22e64-b5fc-4b6b-a54f-9600c386b047 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:15.516075 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-089463ab-2fd3-4185-8d2c-5453e2172b1b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:15.516681 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-089463ab-2fd3-4185-8d2c-5453e2172b1b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:15.540005 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-089463ab-2fd3-4185-8d2c-5453e2172b1b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:15.541369 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-089463ab-2fd3-4185-8d2c-5453e2172b1b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:15.542038 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-089463ab-2fd3-4185-8d2c-5453e2172b1b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:15.543325 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-089463ab-2fd3-4185-8d2c-5453e2172b1b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:15.543993 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-089463ab-2fd3-4185-8d2c-5453e2172b1b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:15.545770 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-089463ab-2fd3-4185-8d2c-5453e2172b1b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:15.619092 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-2eb22e64-b5fc-4b6b-a54f-9600c386b047 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b8da543ad543bb95881450e4f9b585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5f61674804f93bd2127fc76919bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:15.627640 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-2eb22e64-b5fc-4b6b-a54f-9600c386b047 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] 10.222.0.65 "GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e" status: 200 len: 1318 microversion: 2.1 time: 0.291558 Aug 31 19:16:15.632787 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 302/597] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:15 2022] GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e => generated 1318 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:16:15.733095 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-089463ab-2fd3-4185-8d2c-5453e2172b1b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:15.742979 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-089463ab-2fd3-4185-8d2c-5453e2172b1b tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1372 microversion: 2.1 time: 0.230675 Aug 31 19:16:15.752566 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 296/598] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:15 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1372 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:16:15.902219 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-08631a72-c138-4773-901a-2e0031bef49b tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:15.902688 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-08631a72-c138-4773-901a-2e0031bef49b tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:15.910082 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-08631a72-c138-4773-901a-2e0031bef49b tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:15.910559 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-08631a72-c138-4773-901a-2e0031bef49b tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:15.910996 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-08631a72-c138-4773-901a-2e0031bef49b tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:15.911694 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-08631a72-c138-4773-901a-2e0031bef49b tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:15.917644 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-08631a72-c138-4773-901a-2e0031bef49b tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:15.918098 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-08631a72-c138-4773-901a-2e0031bef49b tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:16.256097 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-08631a72-c138-4773-901a-2e0031bef49b tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:16.268444 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-08631a72-c138-4773-901a-2e0031bef49b tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1259 microversion: 2.1 time: 0.370274 Aug 31 19:16:16.270221 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 303/599] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:15 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1259 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:16:16.655677 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-273d26e9-fc90-4c57-a9b7-a3836a37a7bc tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:16.658261 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-273d26e9-fc90-4c57-a9b7-a3836a37a7bc tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: 99d78918-36ca-462d-9037-ea8b81fbfc2e] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:16.670723 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-273d26e9-fc90-4c57-a9b7-a3836a37a7bc tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:16.671695 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-273d26e9-fc90-4c57-a9b7-a3836a37a7bc tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:16.672440 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-273d26e9-fc90-4c57-a9b7-a3836a37a7bc tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:16.673623 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-273d26e9-fc90-4c57-a9b7-a3836a37a7bc tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:16.675002 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-273d26e9-fc90-4c57-a9b7-a3836a37a7bc tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:16.676053 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-273d26e9-fc90-4c57-a9b7-a3836a37a7bc tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:16.774757 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-6218ebd0-a624-422f-b922-7b403f2774df tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:16.776268 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-6218ebd0-a624-422f-b922-7b403f2774df tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:16.793912 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6218ebd0-a624-422f-b922-7b403f2774df tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:16.801705 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6218ebd0-a624-422f-b922-7b403f2774df tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:16.805141 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6218ebd0-a624-422f-b922-7b403f2774df tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:16.809936 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6218ebd0-a624-422f-b922-7b403f2774df tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:16.810719 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6218ebd0-a624-422f-b922-7b403f2774df tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:16.811305 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6218ebd0-a624-422f-b922-7b403f2774df tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:17.266707 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-273d26e9-fc90-4c57-a9b7-a3836a37a7bc tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b8da543ad543bb95881450e4f9b585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5f61674804f93bd2127fc76919bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:17.271933 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=100 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:16:17.279057 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-273d26e9-fc90-4c57-a9b7-a3836a37a7bc tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] 10.222.0.65 "GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e" status: 200 len: 1318 microversion: 2.1 time: 0.629634 Aug 31 19:16:17.280805 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 297/600] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:16 2022] GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e => generated 1318 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:16:17.298906 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-d44cd54d-040f-441d-b916-bcc5b66185aa tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:17.299553 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-d44cd54d-040f-441d-b916-bcc5b66185aa tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:17.319065 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d44cd54d-040f-441d-b916-bcc5b66185aa tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:17.319768 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d44cd54d-040f-441d-b916-bcc5b66185aa tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:17.320374 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d44cd54d-040f-441d-b916-bcc5b66185aa tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:17.321260 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d44cd54d-040f-441d-b916-bcc5b66185aa tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:17.322040 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d44cd54d-040f-441d-b916-bcc5b66185aa tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:17.322755 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d44cd54d-040f-441d-b916-bcc5b66185aa tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:17.434798 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-6218ebd0-a624-422f-b922-7b403f2774df tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:17.489536 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-6218ebd0-a624-422f-b922-7b403f2774df tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1372 microversion: 2.1 time: 0.720300 Aug 31 19:16:17.493836 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 304/601] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:16 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1372 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:16:17.524128 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-d44cd54d-040f-441d-b916-bcc5b66185aa tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:17.533065 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-d44cd54d-040f-441d-b916-bcc5b66185aa tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1259 microversion: 2.1 time: 0.245572 Aug 31 19:16:17.533681 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 298/602] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:17 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1259 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:16:18.315514 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e129a1df-c9f5-44ae-bc28-94a3cb4e614b tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:18.316906 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-e129a1df-c9f5-44ae-bc28-94a3cb4e614b tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: 99d78918-36ca-462d-9037-ea8b81fbfc2e] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:18.331760 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e129a1df-c9f5-44ae-bc28-94a3cb4e614b tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:18.334070 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e129a1df-c9f5-44ae-bc28-94a3cb4e614b tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:18.336309 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e129a1df-c9f5-44ae-bc28-94a3cb4e614b tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:18.338605 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e129a1df-c9f5-44ae-bc28-94a3cb4e614b tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:18.339322 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e129a1df-c9f5-44ae-bc28-94a3cb4e614b tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:18.340429 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e129a1df-c9f5-44ae-bc28-94a3cb4e614b tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:18.516292 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-284df747-6da3-4d6d-bac5-b0840dd8355e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:18.517066 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-284df747-6da3-4d6d-bac5-b0840dd8355e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:18.534961 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-284df747-6da3-4d6d-bac5-b0840dd8355e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:18.538966 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-284df747-6da3-4d6d-bac5-b0840dd8355e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:18.541200 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-284df747-6da3-4d6d-bac5-b0840dd8355e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:18.545589 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-284df747-6da3-4d6d-bac5-b0840dd8355e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:18.546528 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-284df747-6da3-4d6d-bac5-b0840dd8355e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:18.548622 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-284df747-6da3-4d6d-bac5-b0840dd8355e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:18.794308 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-284df747-6da3-4d6d-bac5-b0840dd8355e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:18.803788 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-284df747-6da3-4d6d-bac5-b0840dd8355e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1372 microversion: 2.1 time: 0.292547 Aug 31 19:16:18.811421 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 299/603] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:18 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1372 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:16:18.817573 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-12a9c495-5a1c-4215-a46f-16a0fd7d749c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:18.818370 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-12a9c495-5a1c-4215-a46f-16a0fd7d749c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:18.824923 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-12a9c495-5a1c-4215-a46f-16a0fd7d749c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:18.825637 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-12a9c495-5a1c-4215-a46f-16a0fd7d749c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:18.827049 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-12a9c495-5a1c-4215-a46f-16a0fd7d749c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:18.828097 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-12a9c495-5a1c-4215-a46f-16a0fd7d749c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:18.828709 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-12a9c495-5a1c-4215-a46f-16a0fd7d749c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:18.829324 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-12a9c495-5a1c-4215-a46f-16a0fd7d749c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:18.926692 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e129a1df-c9f5-44ae-bc28-94a3cb4e614b tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b8da543ad543bb95881450e4f9b585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5f61674804f93bd2127fc76919bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:18.937271 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-e129a1df-c9f5-44ae-bc28-94a3cb4e614b tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] 10.222.0.65 "GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e" status: 200 len: 1318 microversion: 2.1 time: 0.636980 Aug 31 19:16:18.949044 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 305/604] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:18 2022] GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e => generated 1318 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:16:18.955471 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-56484cda-cbd6-4284-a57b-916e8a4532ec req-c71a78f0-da76-4094-8243-9383fee26449 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99d78918-36ca-462d-9037-ea8b81fbfc2e", "name": "network-vif-plugged", "status": "completed", "tag": "26de47b8-1d7b-4d14-aacf-b275eb478d29"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:16:18.987562 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-56484cda-cbd6-4284-a57b-916e8a4532ec req-c71a78f0-da76-4094-8243-9383fee26449 service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:18.988298 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-56484cda-cbd6-4284-a57b-916e8a4532ec req-c71a78f0-da76-4094-8243-9383fee26449 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:18.988908 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-56484cda-cbd6-4284-a57b-916e8a4532ec req-c71a78f0-da76-4094-8243-9383fee26449 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:19.032065 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-56484cda-cbd6-4284-a57b-916e8a4532ec req-c71a78f0-da76-4094-8243-9383fee26449 service nova] Creating event network-vif-plugged:26de47b8-1d7b-4d14-aacf-b275eb478d29 for instance 99d78918-36ca-462d-9037-ea8b81fbfc2e on hv-cinder-83538 Aug 31 19:16:19.054027 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-56484cda-cbd6-4284-a57b-916e8a4532ec req-c71a78f0-da76-4094-8243-9383fee26449 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103366 Aug 31 19:16:19.054916 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 306/605] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:16:19.080119 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-12a9c495-5a1c-4215-a46f-16a0fd7d749c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:19.088634 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-12a9c495-5a1c-4215-a46f-16a0fd7d749c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1259 microversion: 2.1 time: 0.275507 Aug 31 19:16:19.089250 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 300/606] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:18 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1259 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:16:19.843586 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-56f91755-5bc5-4cf2-b2b4-ac4c825ce425 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:19.844945 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-56f91755-5bc5-4cf2-b2b4-ac4c825ce425 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:19.853204 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-56f91755-5bc5-4cf2-b2b4-ac4c825ce425 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:19.854781 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-56f91755-5bc5-4cf2-b2b4-ac4c825ce425 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:19.855432 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-56f91755-5bc5-4cf2-b2b4-ac4c825ce425 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:19.856341 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-56f91755-5bc5-4cf2-b2b4-ac4c825ce425 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:19.857045 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-56f91755-5bc5-4cf2-b2b4-ac4c825ce425 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:19.858618 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-56f91755-5bc5-4cf2-b2b4-ac4c825ce425 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:19.972764 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-0271187c-53b7-461d-bdd4-2055387d7d85 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:19.973405 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-0271187c-53b7-461d-bdd4-2055387d7d85 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: 99d78918-36ca-462d-9037-ea8b81fbfc2e] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:19.989009 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0271187c-53b7-461d-bdd4-2055387d7d85 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:19.989527 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0271187c-53b7-461d-bdd4-2055387d7d85 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:19.989967 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0271187c-53b7-461d-bdd4-2055387d7d85 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:19.990672 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0271187c-53b7-461d-bdd4-2055387d7d85 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:19.991309 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0271187c-53b7-461d-bdd4-2055387d7d85 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:19.991890 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0271187c-53b7-461d-bdd4-2055387d7d85 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:20.084486 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-56f91755-5bc5-4cf2-b2b4-ac4c825ce425 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:20.093562 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-56f91755-5bc5-4cf2-b2b4-ac4c825ce425 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1372 microversion: 2.1 time: 0.265743 Aug 31 19:16:20.094265 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 307/607] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:19 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1372 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:16:20.111182 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-49fdb0f8-365f-48f8-815b-163a13aa7366 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:20.111796 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-49fdb0f8-365f-48f8-815b-163a13aa7366 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:20.124426 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-49fdb0f8-365f-48f8-815b-163a13aa7366 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:20.124933 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-49fdb0f8-365f-48f8-815b-163a13aa7366 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:20.125568 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-49fdb0f8-365f-48f8-815b-163a13aa7366 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:20.131590 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-49fdb0f8-365f-48f8-815b-163a13aa7366 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:20.132190 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-49fdb0f8-365f-48f8-815b-163a13aa7366 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:20.132641 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-49fdb0f8-365f-48f8-815b-163a13aa7366 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:20.268459 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-0271187c-53b7-461d-bdd4-2055387d7d85 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b8da543ad543bb95881450e4f9b585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5f61674804f93bd2127fc76919bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:20.281907 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-0271187c-53b7-461d-bdd4-2055387d7d85 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] 10.222.0.65 "GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e" status: 200 len: 1318 microversion: 2.1 time: 0.313168 Aug 31 19:16:20.282868 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 301/608] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:19 2022] GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e => generated 1318 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:16:20.460460 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-49fdb0f8-365f-48f8-815b-163a13aa7366 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:20.468340 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-49fdb0f8-365f-48f8-815b-163a13aa7366 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1259 microversion: 2.1 time: 0.362504 Aug 31 19:16:20.471749 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 308/609] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:20 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1259 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:16:21.114904 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-cccc94a8-b7e6-4293-ad19-d740308591a1 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:21.116191 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-cccc94a8-b7e6-4293-ad19-d740308591a1 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:21.125440 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cccc94a8-b7e6-4293-ad19-d740308591a1 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:21.126297 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cccc94a8-b7e6-4293-ad19-d740308591a1 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:21.126965 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cccc94a8-b7e6-4293-ad19-d740308591a1 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:21.128500 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cccc94a8-b7e6-4293-ad19-d740308591a1 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:21.129169 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cccc94a8-b7e6-4293-ad19-d740308591a1 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:21.129836 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cccc94a8-b7e6-4293-ad19-d740308591a1 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:21.303528 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-dee720c9-f1c7-4916-bc30-33920df91721 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:21.304855 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-dee720c9-f1c7-4916-bc30-33920df91721 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: 99d78918-36ca-462d-9037-ea8b81fbfc2e] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:21.318442 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-dee720c9-f1c7-4916-bc30-33920df91721 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:21.320788 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-dee720c9-f1c7-4916-bc30-33920df91721 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:21.322907 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-dee720c9-f1c7-4916-bc30-33920df91721 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:21.329084 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-dee720c9-f1c7-4916-bc30-33920df91721 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:21.330035 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-dee720c9-f1c7-4916-bc30-33920df91721 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:21.331822 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-dee720c9-f1c7-4916-bc30-33920df91721 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:21.427102 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-cccc94a8-b7e6-4293-ad19-d740308591a1 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:21.437642 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-cccc94a8-b7e6-4293-ad19-d740308591a1 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1372 microversion: 2.1 time: 0.326429 Aug 31 19:16:21.439397 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 302/610] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:21 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1372 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:16:21.488925 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-a30f7cbe-3fcd-4b30-9e85-44e34f41c9b5 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:21.489557 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-a30f7cbe-3fcd-4b30-9e85-44e34f41c9b5 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:21.500673 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a30f7cbe-3fcd-4b30-9e85-44e34f41c9b5 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:21.501169 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a30f7cbe-3fcd-4b30-9e85-44e34f41c9b5 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:21.502185 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a30f7cbe-3fcd-4b30-9e85-44e34f41c9b5 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:21.502903 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a30f7cbe-3fcd-4b30-9e85-44e34f41c9b5 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:21.503357 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a30f7cbe-3fcd-4b30-9e85-44e34f41c9b5 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:21.503777 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a30f7cbe-3fcd-4b30-9e85-44e34f41c9b5 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:21.763733 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-a30f7cbe-3fcd-4b30-9e85-44e34f41c9b5 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:21.774605 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-a30f7cbe-3fcd-4b30-9e85-44e34f41c9b5 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1259 microversion: 2.1 time: 0.289050 Aug 31 19:16:21.775778 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 303/611] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:21 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1259 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:16:21.926568 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-dee720c9-f1c7-4916-bc30-33920df91721 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b8da543ad543bb95881450e4f9b585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5f61674804f93bd2127fc76919bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:21.934437 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-dee720c9-f1c7-4916-bc30-33920df91721 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] 10.222.0.65 "GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e" status: 200 len: 1318 microversion: 2.1 time: 0.635645 Aug 31 19:16:21.937534 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 309/612] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:21 2022] GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e => generated 1318 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:16:22.487148 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-f8e47f4f-79e8-4b91-99e8-b38fb28942b0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:22.487704 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-f8e47f4f-79e8-4b91-99e8-b38fb28942b0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:22.495569 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f8e47f4f-79e8-4b91-99e8-b38fb28942b0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:22.496068 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f8e47f4f-79e8-4b91-99e8-b38fb28942b0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:22.496611 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f8e47f4f-79e8-4b91-99e8-b38fb28942b0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:22.497563 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f8e47f4f-79e8-4b91-99e8-b38fb28942b0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:22.498222 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f8e47f4f-79e8-4b91-99e8-b38fb28942b0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:22.499004 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f8e47f4f-79e8-4b91-99e8-b38fb28942b0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:22.753938 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-96e57f89-2234-4478-9907-6e83be8aca84 req-e8f8f24d-9bda-4a3c-9944-3b18aae6e662 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52d843ca-5f08-47f6-98dc-2df1d30438cc", "name": "network-vif-plugged", "status": "completed", "tag": "4fdbfd0c-e43a-4c2c-ab61-0f67e2dfee09"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:16:22.764807 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-f8e47f4f-79e8-4b91-99e8-b38fb28942b0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:22.778422 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-f8e47f4f-79e8-4b91-99e8-b38fb28942b0 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1372 microversion: 2.1 time: 0.318372 Aug 31 19:16:22.779271 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 304/613] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:22 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1372 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:16:22.785272 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-96e57f89-2234-4478-9907-6e83be8aca84 req-e8f8f24d-9bda-4a3c-9944-3b18aae6e662 service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:22.785753 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-96e57f89-2234-4478-9907-6e83be8aca84 req-e8f8f24d-9bda-4a3c-9944-3b18aae6e662 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:22.786172 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-96e57f89-2234-4478-9907-6e83be8aca84 req-e8f8f24d-9bda-4a3c-9944-3b18aae6e662 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:22.800631 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-1dce351f-46b3-4cbf-8785-c22f25338c70 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:22.803454 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-1dce351f-46b3-4cbf-8785-c22f25338c70 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:22.804172 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-96e57f89-2234-4478-9907-6e83be8aca84 req-e8f8f24d-9bda-4a3c-9944-3b18aae6e662 service nova] Creating event network-vif-plugged:4fdbfd0c-e43a-4c2c-ab61-0f67e2dfee09 for instance 52d843ca-5f08-47f6-98dc-2df1d30438cc on hv-cinder-83538 Aug 31 19:16:22.822246 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1dce351f-46b3-4cbf-8785-c22f25338c70 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:22.823090 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1dce351f-46b3-4cbf-8785-c22f25338c70 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:22.823537 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1dce351f-46b3-4cbf-8785-c22f25338c70 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:22.827672 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1dce351f-46b3-4cbf-8785-c22f25338c70 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:22.827796 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-96e57f89-2234-4478-9907-6e83be8aca84 req-e8f8f24d-9bda-4a3c-9944-3b18aae6e662 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079564 Aug 31 19:16:22.828755 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 310/614] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:16:22.829655 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1dce351f-46b3-4cbf-8785-c22f25338c70 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:22.830263 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1dce351f-46b3-4cbf-8785-c22f25338c70 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:22.962754 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-4f75bf7d-ff33-456c-96f8-51cb8483bf90 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:22.963511 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-4f75bf7d-ff33-456c-96f8-51cb8483bf90 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: 99d78918-36ca-462d-9037-ea8b81fbfc2e] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:22.975414 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4f75bf7d-ff33-456c-96f8-51cb8483bf90 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:22.975915 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4f75bf7d-ff33-456c-96f8-51cb8483bf90 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:22.976349 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4f75bf7d-ff33-456c-96f8-51cb8483bf90 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:22.978162 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4f75bf7d-ff33-456c-96f8-51cb8483bf90 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:22.981515 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4f75bf7d-ff33-456c-96f8-51cb8483bf90 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:22.982257 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4f75bf7d-ff33-456c-96f8-51cb8483bf90 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:23.112472 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-1dce351f-46b3-4cbf-8785-c22f25338c70 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:23.132763 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-1dce351f-46b3-4cbf-8785-c22f25338c70 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1259 microversion: 2.1 time: 0.336396 Aug 31 19:16:23.137318 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 305/615] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:22 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1259 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:16:23.312161 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-4f75bf7d-ff33-456c-96f8-51cb8483bf90 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b8da543ad543bb95881450e4f9b585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5f61674804f93bd2127fc76919bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:23.330829 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-4f75bf7d-ff33-456c-96f8-51cb8483bf90 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] 10.222.0.65 "GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e" status: 200 len: 1506 microversion: 2.1 time: 0.372469 Aug 31 19:16:23.332057 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 311/616] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:22 2022] GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e => generated 1506 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:16:23.803442 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-e4d84b09-009a-4d61-a8ec-3e5a257b99ce tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:23.805048 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-e4d84b09-009a-4d61-a8ec-3e5a257b99ce tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:23.819660 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e4d84b09-009a-4d61-a8ec-3e5a257b99ce tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:23.820440 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e4d84b09-009a-4d61-a8ec-3e5a257b99ce tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:23.821182 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e4d84b09-009a-4d61-a8ec-3e5a257b99ce tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:23.822035 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e4d84b09-009a-4d61-a8ec-3e5a257b99ce tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:23.823453 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e4d84b09-009a-4d61-a8ec-3e5a257b99ce tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:23.823989 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e4d84b09-009a-4d61-a8ec-3e5a257b99ce tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:24.162373 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-98ae16dd-e829-4b20-a1c7-b0a5af3ea951 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:24.163609 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-98ae16dd-e829-4b20-a1c7-b0a5af3ea951 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:24.183082 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-98ae16dd-e829-4b20-a1c7-b0a5af3ea951 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:24.189404 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-98ae16dd-e829-4b20-a1c7-b0a5af3ea951 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:24.191896 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-98ae16dd-e829-4b20-a1c7-b0a5af3ea951 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:24.194788 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-98ae16dd-e829-4b20-a1c7-b0a5af3ea951 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:24.197554 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-98ae16dd-e829-4b20-a1c7-b0a5af3ea951 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:24.198738 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-98ae16dd-e829-4b20-a1c7-b0a5af3ea951 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:24.250054 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-e4d84b09-009a-4d61-a8ec-3e5a257b99ce tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:24.260421 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-e4d84b09-009a-4d61-a8ec-3e5a257b99ce tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1372 microversion: 2.1 time: 0.464310 Aug 31 19:16:24.267548 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 306/617] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:23 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1372 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:16:24.534806 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-98ae16dd-e829-4b20-a1c7-b0a5af3ea951 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:24.543136 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-98ae16dd-e829-4b20-a1c7-b0a5af3ea951 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1259 microversion: 2.1 time: 0.386233 Aug 31 19:16:24.546349 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 312/618] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:24 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1259 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:16:24.850102 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-3308ad8f-05a0-494c-b3cf-5f288af5112e req-b4059b29-19ed-4ef3-82e8-cf6b4ff5da87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c81a2adf-d0a7-44b6-abf6-74f03fe93857", "name": "network-vif-plugged", "status": "completed", "tag": "2ccb095c-a665-47ff-bcff-65a4dc08d119"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:16:24.872122 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-3308ad8f-05a0-494c-b3cf-5f288af5112e req-b4059b29-19ed-4ef3-82e8-cf6b4ff5da87 service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:24.877583 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-3308ad8f-05a0-494c-b3cf-5f288af5112e req-b4059b29-19ed-4ef3-82e8-cf6b4ff5da87 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:24.878258 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-3308ad8f-05a0-494c-b3cf-5f288af5112e req-b4059b29-19ed-4ef3-82e8-cf6b4ff5da87 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:24.891641 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-3308ad8f-05a0-494c-b3cf-5f288af5112e req-b4059b29-19ed-4ef3-82e8-cf6b4ff5da87 service nova] Creating event network-vif-plugged:2ccb095c-a665-47ff-bcff-65a4dc08d119 for instance c81a2adf-d0a7-44b6-abf6-74f03fe93857 on hv-cinder-83538 Aug 31 19:16:24.897675 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-3308ad8f-05a0-494c-b3cf-5f288af5112e req-b4059b29-19ed-4ef3-82e8-cf6b4ff5da87 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051130 Aug 31 19:16:24.898802 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 307/619] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:16:25.288419 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e2c4f56b-91fc-41b8-b9d8-94323d41ecaa tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:25.289808 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-e2c4f56b-91fc-41b8-b9d8-94323d41ecaa tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:25.303646 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e2c4f56b-91fc-41b8-b9d8-94323d41ecaa tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:25.304424 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e2c4f56b-91fc-41b8-b9d8-94323d41ecaa tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:25.306079 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e2c4f56b-91fc-41b8-b9d8-94323d41ecaa tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:25.308100 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e2c4f56b-91fc-41b8-b9d8-94323d41ecaa tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:25.309818 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e2c4f56b-91fc-41b8-b9d8-94323d41ecaa tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:25.311771 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e2c4f56b-91fc-41b8-b9d8-94323d41ecaa tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:25.547399 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e2c4f56b-91fc-41b8-b9d8-94323d41ecaa tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:25.555450 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-e2c4f56b-91fc-41b8-b9d8-94323d41ecaa tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1372 microversion: 2.1 time: 0.271229 Aug 31 19:16:25.559792 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 313/620] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:25 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1372 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:16:25.573536 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-248f1a68-b0e2-4e1f-a5d9-4f7929085b06 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:25.574239 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-248f1a68-b0e2-4e1f-a5d9-4f7929085b06 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:25.586448 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-248f1a68-b0e2-4e1f-a5d9-4f7929085b06 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:25.587295 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-248f1a68-b0e2-4e1f-a5d9-4f7929085b06 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:25.587923 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-248f1a68-b0e2-4e1f-a5d9-4f7929085b06 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:25.588896 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-248f1a68-b0e2-4e1f-a5d9-4f7929085b06 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:25.589603 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-248f1a68-b0e2-4e1f-a5d9-4f7929085b06 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:25.590526 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-248f1a68-b0e2-4e1f-a5d9-4f7929085b06 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:26.063720 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-248f1a68-b0e2-4e1f-a5d9-4f7929085b06 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:26.081307 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-248f1a68-b0e2-4e1f-a5d9-4f7929085b06 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1443 microversion: 2.1 time: 0.509677 Aug 31 19:16:26.082206 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 308/621] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:25 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1443 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:16:26.109601 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-3e3f1f7c-48fa-4f86-ae1a-cfd9d4bb9488 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:26.110476 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-3e3f1f7c-48fa-4f86-ae1a-cfd9d4bb9488 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:26.120110 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=72 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:16:26.122465 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3e3f1f7c-48fa-4f86-ae1a-cfd9d4bb9488 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:26.124271 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3e3f1f7c-48fa-4f86-ae1a-cfd9d4bb9488 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:26.126077 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3e3f1f7c-48fa-4f86-ae1a-cfd9d4bb9488 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:26.126973 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3e3f1f7c-48fa-4f86-ae1a-cfd9d4bb9488 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:26.128562 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3e3f1f7c-48fa-4f86-ae1a-cfd9d4bb9488 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:26.129143 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3e3f1f7c-48fa-4f86-ae1a-cfd9d4bb9488 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:26.473935 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-3e3f1f7c-48fa-4f86-ae1a-cfd9d4bb9488 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:26.487693 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-3e3f1f7c-48fa-4f86-ae1a-cfd9d4bb9488 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1443 microversion: 2.1 time: 0.383583 Aug 31 19:16:26.488892 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 314/622] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:26 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1443 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:16:26.583460 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-850a6db9-d3c8-41a4-b716-002dd743884e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:26.584108 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-850a6db9-d3c8-41a4-b716-002dd743884e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:26.592421 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-850a6db9-d3c8-41a4-b716-002dd743884e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:26.592912 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-850a6db9-d3c8-41a4-b716-002dd743884e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:26.593370 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-850a6db9-d3c8-41a4-b716-002dd743884e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:26.594078 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-850a6db9-d3c8-41a4-b716-002dd743884e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:26.607129 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-850a6db9-d3c8-41a4-b716-002dd743884e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:26.607585 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-850a6db9-d3c8-41a4-b716-002dd743884e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:27.049138 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-850a6db9-d3c8-41a4-b716-002dd743884e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:27.065946 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-850a6db9-d3c8-41a4-b716-002dd743884e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1372 microversion: 2.1 time: 0.486983 Aug 31 19:16:27.068688 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 309/623] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:26 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1372 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:16:28.089134 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-0adf6871-6152-4b47-9591-ecaa569efeca tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:28.092290 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-0adf6871-6152-4b47-9591-ecaa569efeca tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:28.104459 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0adf6871-6152-4b47-9591-ecaa569efeca tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:28.104863 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0adf6871-6152-4b47-9591-ecaa569efeca tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:28.105332 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0adf6871-6152-4b47-9591-ecaa569efeca tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:28.106045 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0adf6871-6152-4b47-9591-ecaa569efeca tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:28.106511 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0adf6871-6152-4b47-9591-ecaa569efeca tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:28.106937 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0adf6871-6152-4b47-9591-ecaa569efeca tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:29.343698 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-0adf6871-6152-4b47-9591-ecaa569efeca tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:29.355445 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-0adf6871-6152-4b47-9591-ecaa569efeca tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1372 microversion: 2.1 time: 1.270033 Aug 31 19:16:29.366477 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 315/624] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:28 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1372 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:16:30.387765 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-3dfa1b80-cc0d-45cd-b386-7197010cf37e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:30.389287 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-3dfa1b80-cc0d-45cd-b386-7197010cf37e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:30.409005 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3dfa1b80-cc0d-45cd-b386-7197010cf37e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:30.409810 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3dfa1b80-cc0d-45cd-b386-7197010cf37e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:30.410712 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3dfa1b80-cc0d-45cd-b386-7197010cf37e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:30.415405 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3dfa1b80-cc0d-45cd-b386-7197010cf37e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:30.416141 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3dfa1b80-cc0d-45cd-b386-7197010cf37e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:30.416965 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3dfa1b80-cc0d-45cd-b386-7197010cf37e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:30.906810 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-3dfa1b80-cc0d-45cd-b386-7197010cf37e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:30.919476 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-3dfa1b80-cc0d-45cd-b386-7197010cf37e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1566 microversion: 2.1 time: 0.534257 Aug 31 19:16:30.922343 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 310/625] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:30 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1566 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:16:30.943027 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-21f7e0b1-cdf9-4c04-b162-6bcb8df9617a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:30.943652 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-21f7e0b1-cdf9-4c04-b162-6bcb8df9617a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:30.955088 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-21f7e0b1-cdf9-4c04-b162-6bcb8df9617a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:30.955592 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-21f7e0b1-cdf9-4c04-b162-6bcb8df9617a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:30.956022 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-21f7e0b1-cdf9-4c04-b162-6bcb8df9617a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:30.956728 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-21f7e0b1-cdf9-4c04-b162-6bcb8df9617a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:30.957180 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-21f7e0b1-cdf9-4c04-b162-6bcb8df9617a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:30.965953 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-21f7e0b1-cdf9-4c04-b162-6bcb8df9617a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:31.181419 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-21f7e0b1-cdf9-4c04-b162-6bcb8df9617a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.242305 Aug 31 19:16:31.182025 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 316/626] 10.222.0.65 () {58 vars in 1275 bytes} [Wed Aug 31 19:16:30 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857/os-interface => generated 285 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:16:32.130348 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-d3936aa3-4c09-435f-9713-e7279d15a0c5 req-6adc3914-9446-45a2-a3b6-4173423487ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52d843ca-5f08-47f6-98dc-2df1d30438cc", "tag": "4fdbfd0c-e43a-4c2c-ab61-0f67e2dfee09"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:16:32.151241 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-d3936aa3-4c09-435f-9713-e7279d15a0c5 req-6adc3914-9446-45a2-a3b6-4173423487ec service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:32.151731 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-d3936aa3-4c09-435f-9713-e7279d15a0c5 req-6adc3914-9446-45a2-a3b6-4173423487ec service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:32.152160 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-d3936aa3-4c09-435f-9713-e7279d15a0c5 req-6adc3914-9446-45a2-a3b6-4173423487ec service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:32.181675 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-d3936aa3-4c09-435f-9713-e7279d15a0c5 req-6adc3914-9446-45a2-a3b6-4173423487ec service nova] Creating event network-changed:4fdbfd0c-e43a-4c2c-ab61-0f67e2dfee09 for instance 52d843ca-5f08-47f6-98dc-2df1d30438cc on hv-cinder-83538 Aug 31 19:16:32.201908 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-d3936aa3-4c09-435f-9713-e7279d15a0c5 req-6adc3914-9446-45a2-a3b6-4173423487ec service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074615 Aug 31 19:16:32.202963 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 311/627] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:16:33.523207 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-f1898503-c21f-41cc-909e-cf173d5ab60c req-3d719600-11b6-41c6-92bb-14bc0e9e97f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c81a2adf-d0a7-44b6-abf6-74f03fe93857", "tag": "2ccb095c-a665-47ff-bcff-65a4dc08d119"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:16:33.536152 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-f1898503-c21f-41cc-909e-cf173d5ab60c req-3d719600-11b6-41c6-92bb-14bc0e9e97f4 service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:33.536887 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-f1898503-c21f-41cc-909e-cf173d5ab60c req-3d719600-11b6-41c6-92bb-14bc0e9e97f4 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:33.537633 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-f1898503-c21f-41cc-909e-cf173d5ab60c req-3d719600-11b6-41c6-92bb-14bc0e9e97f4 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:33.551507 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-f1898503-c21f-41cc-909e-cf173d5ab60c req-3d719600-11b6-41c6-92bb-14bc0e9e97f4 service nova] Creating event network-changed:2ccb095c-a665-47ff-bcff-65a4dc08d119 for instance c81a2adf-d0a7-44b6-abf6-74f03fe93857 on hv-cinder-83538 Aug 31 19:16:33.563182 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-f1898503-c21f-41cc-909e-cf173d5ab60c req-3d719600-11b6-41c6-92bb-14bc0e9e97f4 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045198 Aug 31 19:16:33.564107 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 317/628] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:16:48.975483 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-1fddf1a3-58e5-49f8-8379-2188b0c6bfb1 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Action: 'create', calling method: .version_select at 0x7fdb89c830d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1966994", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK7Y3yi4PdN+8YIHWhWlz/sAwnONpGZ/qU/aaD0Mda/2zgUtZh6e5cj+DBzFE5STnS87ySQpDhNt7QQNOtSL2Bee6V6vRisQhGfeazCMfEcKjQCw3ahQTkzroUEqojKyrQ=="}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:16:48.988792 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_api:SELECT=47 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:16:48.989491 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=76 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:16:49.000876 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-1fddf1a3-58e5-49f8-8379-2188b0c6bfb1 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Getting quotas for project fe8ee0bdd09b45599a7c19798660aac0. Resources: {'key_pairs'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:16:49.004957 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-1fddf1a3-58e5-49f8-8379-2188b0c6bfb1 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Getting quotas for user a07fb9a216ac4683852fc6cae7c10b99 and project fe8ee0bdd09b45599a7c19798660aac0. Resources: {'key_pairs'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:16:49.027660 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-1fddf1a3-58e5-49f8-8379-2188b0c6bfb1 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.057652 Aug 31 19:16:49.028861 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 312/629] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Aug 31 19:16:48 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:16:49.088182 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=7 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:16:49.088941 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=88 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:16:49.094506 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-52aa8a7b-6a19-475a-855b-b7a5792e047d tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:49.095088 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-52aa8a7b-6a19-475a-855b-b7a5792e047d tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:49.101983 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-52aa8a7b-6a19-475a-855b-b7a5792e047d tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:49.102462 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-52aa8a7b-6a19-475a-855b-b7a5792e047d tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:49.102896 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-52aa8a7b-6a19-475a-855b-b7a5792e047d tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:49.103843 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-52aa8a7b-6a19-475a-855b-b7a5792e047d tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:49.104293 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-52aa8a7b-6a19-475a-855b-b7a5792e047d tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:49.104710 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-52aa8a7b-6a19-475a-855b-b7a5792e047d tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:49.128382 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-7201ddac-a030-4bb3-872b-54cb10f67e8e tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1368677901", "imageRef": "bfc1207d-66fd-489e-82da-57c3c322b239", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1966994", "networks": [{"uuid": "a88072a7-ccd9-4964-8d0f-ea7ca3cf52b8"}]}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:16:49.129755 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-52aa8a7b-6a19-475a-855b-b7a5792e047d tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb/ips" status: 200 len: 148 microversion: 2.1 time: 0.042998 Aug 31 19:16:49.130633 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 318/630] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Aug 31 19:16:49 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb/ips => generated 148 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:16:49.181341 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.network.neutron [None req-7201ddac-a030-4bb3-872b-54cb10f67e8e tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] validate_networks() for [('a88072a7-ccd9-4964-8d0f-ea7ca3cf52b8', None, None, None, None, None)] {{(pid=120624) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:16:49.579009 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-7201ddac-a030-4bb3-872b-54cb10f67e8e tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Flavor limits 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:16:49.579429 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-7201ddac-a030-4bb3-872b-54cb10f67e8e tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Image limits 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:16:49.579926 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-7201ddac-a030-4bb3-872b-54cb10f67e8e tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Flavor pref 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:16:49.580327 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-7201ddac-a030-4bb3-872b-54cb10f67e8e tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Image pref 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:16:49.580728 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-7201ddac-a030-4bb3-872b-54cb10f67e8e tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:16:49.589426 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7201ddac-a030-4bb3-872b-54cb10f67e8e tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:49.589901 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7201ddac-a030-4bb3-872b-54cb10f67e8e tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:49.590325 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7201ddac-a030-4bb3-872b-54cb10f67e8e tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:49.591811 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7201ddac-a030-4bb3-872b-54cb10f67e8e tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:49.592303 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7201ddac-a030-4bb3-872b-54cb10f67e8e tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:49.592701 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7201ddac-a030-4bb3-872b-54cb10f67e8e tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:49.609538 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-7201ddac-a030-4bb3-872b-54cb10f67e8e tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Getting quotas for project fe8ee0bdd09b45599a7c19798660aac0. Resources: {'instances', 'cores', 'ram'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:16:49.613657 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-7201ddac-a030-4bb3-872b-54cb10f67e8e tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Getting quotas for user a07fb9a216ac4683852fc6cae7c10b99 and project fe8ee0bdd09b45599a7c19798660aac0. Resources: {'instances', 'cores', 'ram'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:16:49.624501 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-7201ddac-a030-4bb3-872b-54cb10f67e8e tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Going to run 1 instances... {{(pid=120624) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:16:49.626809 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-7201ddac-a030-4bb3-872b-54cb10f67e8e tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] [instance: 5537ff84-8f70-4ba6-b219-09ffa1164d9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bfc1207d-66fd-489e-82da-57c3c322b239',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120624) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:16:49.675540 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-7201ddac-a030-4bb3-872b-54cb10f67e8e tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.551208 Aug 31 19:16:49.676373 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 313/631] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 31 19:16:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 19:16:49.687648 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-c1cc424d-b5b3-4125-b313-7b34e4c1382c tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:49.688339 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-c1cc424d-b5b3-4125-b313-7b34e4c1382c tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] [instance: 5537ff84-8f70-4ba6-b219-09ffa1164d9a] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:49.748428 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-c1cc424d-b5b3-4125-b313-7b34e4c1382c tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07fb9a216ac4683852fc6cae7c10b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8ee0bdd09b45599a7c19798660aac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:49.756897 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-c1cc424d-b5b3-4125-b313-7b34e4c1382c tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] 10.222.0.65 "GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a" status: 200 len: 1256 microversion: 2.1 time: 0.073868 Aug 31 19:16:49.757817 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 319/632] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:49 2022] GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a => generated 1256 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:16:50.777975 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-5715e568-4063-4a70-b41b-5a047eaf27e2 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:50.779412 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-5715e568-4063-4a70-b41b-5a047eaf27e2 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] [instance: 5537ff84-8f70-4ba6-b219-09ffa1164d9a] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:50.786843 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5715e568-4063-4a70-b41b-5a047eaf27e2 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:50.787326 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5715e568-4063-4a70-b41b-5a047eaf27e2 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:50.787754 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5715e568-4063-4a70-b41b-5a047eaf27e2 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:50.788458 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5715e568-4063-4a70-b41b-5a047eaf27e2 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:50.788933 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5715e568-4063-4a70-b41b-5a047eaf27e2 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:50.789380 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5715e568-4063-4a70-b41b-5a047eaf27e2 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:50.857604 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-5715e568-4063-4a70-b41b-5a047eaf27e2 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07fb9a216ac4683852fc6cae7c10b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8ee0bdd09b45599a7c19798660aac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:50.865900 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-5715e568-4063-4a70-b41b-5a047eaf27e2 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] 10.222.0.65 "GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a" status: 200 len: 1308 microversion: 2.1 time: 0.091934 Aug 31 19:16:50.866495 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 314/633] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:50 2022] GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a => generated 1308 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:16:51.594850 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-fcdd78f9-1e83-47ea-950c-a20a1036452a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3515b79e-01e7-486c-aa74-2552b84a549d"}} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:16:51.597345 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-fcdd78f9-1e83-47ea-950c-a20a1036452a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:51.604547 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fcdd78f9-1e83-47ea-950c-a20a1036452a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:51.605034 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fcdd78f9-1e83-47ea-950c-a20a1036452a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:51.605503 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fcdd78f9-1e83-47ea-950c-a20a1036452a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:51.606872 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fcdd78f9-1e83-47ea-950c-a20a1036452a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:51.607325 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fcdd78f9-1e83-47ea-950c-a20a1036452a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:51.607747 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fcdd78f9-1e83-47ea-950c-a20a1036452a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:51.889856 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-3796cb52-573d-4883-afc0-1548d38c8898 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:51.890989 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-3796cb52-573d-4883-afc0-1548d38c8898 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] [instance: 5537ff84-8f70-4ba6-b219-09ffa1164d9a] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:51.904702 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3796cb52-573d-4883-afc0-1548d38c8898 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:51.905295 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3796cb52-573d-4883-afc0-1548d38c8898 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:51.905634 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3796cb52-573d-4883-afc0-1548d38c8898 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:51.906342 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3796cb52-573d-4883-afc0-1548d38c8898 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:51.906794 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3796cb52-573d-4883-afc0-1548d38c8898 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:51.907205 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3796cb52-573d-4883-afc0-1548d38c8898 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:52.042535 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-fcdd78f9-1e83-47ea-950c-a20a1036452a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "POST /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.453388 Aug 31 19:16:52.044583 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 320/634] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 31 19:16:51 2022] POST /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb/os-volume_attachments => generated 194 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:16:52.165784 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-3796cb52-573d-4883-afc0-1548d38c8898 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07fb9a216ac4683852fc6cae7c10b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8ee0bdd09b45599a7c19798660aac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:52.178384 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-3796cb52-573d-4883-afc0-1548d38c8898 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] 10.222.0.65 "GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a" status: 200 len: 1356 microversion: 2.1 time: 0.293877 Aug 31 19:16:52.178972 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 315/635] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:51 2022] GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a => generated 1356 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:16:53.200622 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-bf642b75-f280-45a8-a95d-ba049fd5efc0 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:53.201335 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-bf642b75-f280-45a8-a95d-ba049fd5efc0 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] [instance: 5537ff84-8f70-4ba6-b219-09ffa1164d9a] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:53.207994 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bf642b75-f280-45a8-a95d-ba049fd5efc0 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:53.208468 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bf642b75-f280-45a8-a95d-ba049fd5efc0 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:53.208887 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bf642b75-f280-45a8-a95d-ba049fd5efc0 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:53.209615 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bf642b75-f280-45a8-a95d-ba049fd5efc0 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:53.210062 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bf642b75-f280-45a8-a95d-ba049fd5efc0 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:53.210667 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bf642b75-f280-45a8-a95d-ba049fd5efc0 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:53.358494 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-bf642b75-f280-45a8-a95d-ba049fd5efc0 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07fb9a216ac4683852fc6cae7c10b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8ee0bdd09b45599a7c19798660aac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:53.366423 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-bf642b75-f280-45a8-a95d-ba049fd5efc0 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] 10.222.0.65 "GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a" status: 200 len: 1356 microversion: 2.1 time: 0.170419 Aug 31 19:16:53.366987 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 321/636] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:53 2022] GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a => generated 1356 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:16:54.386994 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-8e438a44-5c7d-4070-a333-8afbc7080c1c tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:54.387694 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-8e438a44-5c7d-4070-a333-8afbc7080c1c tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] [instance: 5537ff84-8f70-4ba6-b219-09ffa1164d9a] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:54.394237 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8e438a44-5c7d-4070-a333-8afbc7080c1c tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:54.394723 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8e438a44-5c7d-4070-a333-8afbc7080c1c tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:54.395153 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8e438a44-5c7d-4070-a333-8afbc7080c1c tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:54.395867 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8e438a44-5c7d-4070-a333-8afbc7080c1c tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:54.396318 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8e438a44-5c7d-4070-a333-8afbc7080c1c tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:54.396735 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8e438a44-5c7d-4070-a333-8afbc7080c1c tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:54.533473 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-8e438a44-5c7d-4070-a333-8afbc7080c1c tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07fb9a216ac4683852fc6cae7c10b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8ee0bdd09b45599a7c19798660aac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:54.541454 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-8e438a44-5c7d-4070-a333-8afbc7080c1c tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] 10.222.0.65 "GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a" status: 200 len: 1356 microversion: 2.1 time: 0.158237 Aug 31 19:16:54.542259 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 316/637] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:54 2022] GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a => generated 1356 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:16:55.395255 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-910612a5-37be-449e-aaad-454bf2eef4d9 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f7aecfd8-81db-4c74-870e-d0b57645cefc", "device": "/dev/sdb"}} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:16:55.398435 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-910612a5-37be-449e-aaad-454bf2eef4d9 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: 99d78918-36ca-462d-9037-ea8b81fbfc2e] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:55.405492 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-910612a5-37be-449e-aaad-454bf2eef4d9 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:55.406092 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-910612a5-37be-449e-aaad-454bf2eef4d9 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:55.406601 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-910612a5-37be-449e-aaad-454bf2eef4d9 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:55.407309 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-910612a5-37be-449e-aaad-454bf2eef4d9 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:55.407763 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-910612a5-37be-449e-aaad-454bf2eef4d9 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:55.408184 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-910612a5-37be-449e-aaad-454bf2eef4d9 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:55.563120 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-0262f5e0-848e-4b35-85b7-961ac08765e2 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:55.563734 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-0262f5e0-848e-4b35-85b7-961ac08765e2 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] [instance: 5537ff84-8f70-4ba6-b219-09ffa1164d9a] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:55.570848 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0262f5e0-848e-4b35-85b7-961ac08765e2 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:55.571337 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0262f5e0-848e-4b35-85b7-961ac08765e2 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:55.571771 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0262f5e0-848e-4b35-85b7-961ac08765e2 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:55.572468 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0262f5e0-848e-4b35-85b7-961ac08765e2 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:55.572919 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0262f5e0-848e-4b35-85b7-961ac08765e2 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:55.573367 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0262f5e0-848e-4b35-85b7-961ac08765e2 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:55.716795 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-0262f5e0-848e-4b35-85b7-961ac08765e2 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07fb9a216ac4683852fc6cae7c10b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8ee0bdd09b45599a7c19798660aac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:55.724952 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-0262f5e0-848e-4b35-85b7-961ac08765e2 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] 10.222.0.65 "GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a" status: 200 len: 1356 microversion: 2.1 time: 0.166138 Aug 31 19:16:55.725798 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 317/638] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:55 2022] GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a => generated 1356 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:16:56.746949 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-08673868-16a8-478d-b697-6e0de3477e84 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:56.748102 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-08673868-16a8-478d-b697-6e0de3477e84 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] [instance: 5537ff84-8f70-4ba6-b219-09ffa1164d9a] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:56.754597 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-08673868-16a8-478d-b697-6e0de3477e84 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:56.755079 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-08673868-16a8-478d-b697-6e0de3477e84 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:56.755512 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-08673868-16a8-478d-b697-6e0de3477e84 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:56.756202 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-08673868-16a8-478d-b697-6e0de3477e84 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:56.756646 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-08673868-16a8-478d-b697-6e0de3477e84 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:56.757069 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-08673868-16a8-478d-b697-6e0de3477e84 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:56.890459 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-08673868-16a8-478d-b697-6e0de3477e84 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07fb9a216ac4683852fc6cae7c10b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8ee0bdd09b45599a7c19798660aac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:56.904590 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-08673868-16a8-478d-b697-6e0de3477e84 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] 10.222.0.65 "GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a" status: 200 len: 1356 microversion: 2.1 time: 0.161106 Aug 31 19:16:56.905573 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 318/639] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:56 2022] GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a => generated 1356 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:16:57.929550 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-1fa38768-a923-4e84-8fd3-2822dd386c11 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:57.930304 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-1fa38768-a923-4e84-8fd3-2822dd386c11 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] [instance: 5537ff84-8f70-4ba6-b219-09ffa1164d9a] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:57.936455 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1fa38768-a923-4e84-8fd3-2822dd386c11 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:57.936934 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1fa38768-a923-4e84-8fd3-2822dd386c11 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:57.937444 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1fa38768-a923-4e84-8fd3-2822dd386c11 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:57.938138 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1fa38768-a923-4e84-8fd3-2822dd386c11 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:57.938585 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1fa38768-a923-4e84-8fd3-2822dd386c11 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:57.938997 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1fa38768-a923-4e84-8fd3-2822dd386c11 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:58.070497 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-1fa38768-a923-4e84-8fd3-2822dd386c11 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07fb9a216ac4683852fc6cae7c10b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8ee0bdd09b45599a7c19798660aac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:58.078443 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-1fa38768-a923-4e84-8fd3-2822dd386c11 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] 10.222.0.65 "GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a" status: 200 len: 1356 microversion: 2.1 time: 0.152922 Aug 31 19:16:58.079004 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 319/640] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:57 2022] GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a => generated 1356 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:16:59.099163 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-99441217-6663-429e-95b3-8a646b14b612 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:59.099900 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-99441217-6663-429e-95b3-8a646b14b612 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] [instance: 5537ff84-8f70-4ba6-b219-09ffa1164d9a] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:16:59.106460 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-99441217-6663-429e-95b3-8a646b14b612 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:59.107440 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-99441217-6663-429e-95b3-8a646b14b612 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:59.107869 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-99441217-6663-429e-95b3-8a646b14b612 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:59.108568 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-99441217-6663-429e-95b3-8a646b14b612 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:59.108997 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-99441217-6663-429e-95b3-8a646b14b612 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:59.109450 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-99441217-6663-429e-95b3-8a646b14b612 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:59.250346 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-99441217-6663-429e-95b3-8a646b14b612 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07fb9a216ac4683852fc6cae7c10b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8ee0bdd09b45599a7c19798660aac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:16:59.258349 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-99441217-6663-429e-95b3-8a646b14b612 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] 10.222.0.65 "GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a" status: 200 len: 1356 microversion: 2.1 time: 0.163023 Aug 31 19:16:59.259300 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 320/641] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:16:59 2022] GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a => generated 1356 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:16:59.753758 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell0:SELECT=2 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:17:00.280101 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-ead33a31-9ba5-43b1-bacd-1b4a1f059079 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:00.280719 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-ead33a31-9ba5-43b1-bacd-1b4a1f059079 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] [instance: 5537ff84-8f70-4ba6-b219-09ffa1164d9a] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:17:00.282519 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell0:SELECT=2 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:17:00.283172 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell0:SELECT=10 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:17:00.289930 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ead33a31-9ba5-43b1-bacd-1b4a1f059079 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:00.290418 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ead33a31-9ba5-43b1-bacd-1b4a1f059079 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:00.290847 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ead33a31-9ba5-43b1-bacd-1b4a1f059079 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:00.291541 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ead33a31-9ba5-43b1-bacd-1b4a1f059079 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:00.292003 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ead33a31-9ba5-43b1-bacd-1b4a1f059079 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:00.292402 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ead33a31-9ba5-43b1-bacd-1b4a1f059079 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:00.430244 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-ead33a31-9ba5-43b1-bacd-1b4a1f059079 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07fb9a216ac4683852fc6cae7c10b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8ee0bdd09b45599a7c19798660aac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:17:00.438441 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-ead33a31-9ba5-43b1-bacd-1b4a1f059079 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] 10.222.0.65 "GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a" status: 200 len: 1356 microversion: 2.1 time: 0.162326 Aug 31 19:17:00.438997 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 321/642] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:17:00 2022] GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a => generated 1356 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:17:01.459747 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-b493d299-2bc8-484d-974e-2342355c7c21 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:01.460452 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-b493d299-2bc8-484d-974e-2342355c7c21 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] [instance: 5537ff84-8f70-4ba6-b219-09ffa1164d9a] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:17:01.466735 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b493d299-2bc8-484d-974e-2342355c7c21 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:01.467212 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b493d299-2bc8-484d-974e-2342355c7c21 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:01.467646 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b493d299-2bc8-484d-974e-2342355c7c21 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:01.468323 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b493d299-2bc8-484d-974e-2342355c7c21 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:01.468770 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b493d299-2bc8-484d-974e-2342355c7c21 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:01.469224 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b493d299-2bc8-484d-974e-2342355c7c21 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:01.603998 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-b493d299-2bc8-484d-974e-2342355c7c21 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07fb9a216ac4683852fc6cae7c10b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8ee0bdd09b45599a7c19798660aac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:17:01.621124 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-b493d299-2bc8-484d-974e-2342355c7c21 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] 10.222.0.65 "GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a" status: 200 len: 1356 microversion: 2.1 time: 0.165237 Aug 31 19:17:01.623079 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 322/643] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:17:01 2022] GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a => generated 1356 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:17:02.644915 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-53f65356-9522-4715-86f5-d88cae921d66 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:02.645700 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-53f65356-9522-4715-86f5-d88cae921d66 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] [instance: 5537ff84-8f70-4ba6-b219-09ffa1164d9a] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:17:02.652111 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-53f65356-9522-4715-86f5-d88cae921d66 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:02.652590 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-53f65356-9522-4715-86f5-d88cae921d66 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:02.653021 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-53f65356-9522-4715-86f5-d88cae921d66 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:02.653738 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-53f65356-9522-4715-86f5-d88cae921d66 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:02.654315 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-53f65356-9522-4715-86f5-d88cae921d66 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:02.654733 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-53f65356-9522-4715-86f5-d88cae921d66 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:02.789613 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-53f65356-9522-4715-86f5-d88cae921d66 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07fb9a216ac4683852fc6cae7c10b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8ee0bdd09b45599a7c19798660aac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:17:02.798014 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-53f65356-9522-4715-86f5-d88cae921d66 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] 10.222.0.65 "GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a" status: 200 len: 1356 microversion: 2.1 time: 0.157504 Aug 31 19:17:02.798771 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 323/644] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:17:02 2022] GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a => generated 1356 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:17:03.819277 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-f97e0cb7-8379-463f-8c33-e81b4437099f tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:03.820076 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-f97e0cb7-8379-463f-8c33-e81b4437099f tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] [instance: 5537ff84-8f70-4ba6-b219-09ffa1164d9a] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:17:03.826909 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f97e0cb7-8379-463f-8c33-e81b4437099f tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:03.827397 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f97e0cb7-8379-463f-8c33-e81b4437099f tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:03.827833 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f97e0cb7-8379-463f-8c33-e81b4437099f tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:03.828532 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f97e0cb7-8379-463f-8c33-e81b4437099f tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:03.828997 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f97e0cb7-8379-463f-8c33-e81b4437099f tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:03.829443 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f97e0cb7-8379-463f-8c33-e81b4437099f tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:04.121928 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-f97e0cb7-8379-463f-8c33-e81b4437099f tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07fb9a216ac4683852fc6cae7c10b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8ee0bdd09b45599a7c19798660aac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:17:04.130043 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-f97e0cb7-8379-463f-8c33-e81b4437099f tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] 10.222.0.65 "GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a" status: 200 len: 1356 microversion: 2.1 time: 0.314804 Aug 31 19:17:04.130622 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 324/645] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:17:03 2022] GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a => generated 1356 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:17:05.151135 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-cefdee01-a2fa-449f-bb4c-493c89ed8f3a tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:05.151817 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-cefdee01-a2fa-449f-bb4c-493c89ed8f3a tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] [instance: 5537ff84-8f70-4ba6-b219-09ffa1164d9a] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:17:05.158789 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cefdee01-a2fa-449f-bb4c-493c89ed8f3a tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:05.159270 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cefdee01-a2fa-449f-bb4c-493c89ed8f3a tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:05.159700 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cefdee01-a2fa-449f-bb4c-493c89ed8f3a tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:05.160385 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cefdee01-a2fa-449f-bb4c-493c89ed8f3a tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:05.160836 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cefdee01-a2fa-449f-bb4c-493c89ed8f3a tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:05.161289 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cefdee01-a2fa-449f-bb4c-493c89ed8f3a tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:05.292145 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-cefdee01-a2fa-449f-bb4c-493c89ed8f3a tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07fb9a216ac4683852fc6cae7c10b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8ee0bdd09b45599a7c19798660aac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:17:05.299728 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-cefdee01-a2fa-449f-bb4c-493c89ed8f3a tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] 10.222.0.65 "GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a" status: 200 len: 1356 microversion: 2.1 time: 0.152502 Aug 31 19:17:05.300293 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 325/646] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:17:05 2022] GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a => generated 1356 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:17:05.403198 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=12 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:17:05.483545 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:17:06.320179 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-e6375356-b8e9-4161-980d-61cfa2579867 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:06.320780 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-e6375356-b8e9-4161-980d-61cfa2579867 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] [instance: 5537ff84-8f70-4ba6-b219-09ffa1164d9a] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:17:06.327331 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e6375356-b8e9-4161-980d-61cfa2579867 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:06.327801 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e6375356-b8e9-4161-980d-61cfa2579867 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:06.328224 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e6375356-b8e9-4161-980d-61cfa2579867 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:06.328894 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e6375356-b8e9-4161-980d-61cfa2579867 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:06.329377 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e6375356-b8e9-4161-980d-61cfa2579867 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:06.329784 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e6375356-b8e9-4161-980d-61cfa2579867 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:06.464904 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-e6375356-b8e9-4161-980d-61cfa2579867 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07fb9a216ac4683852fc6cae7c10b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8ee0bdd09b45599a7c19798660aac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:17:06.473316 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-e6375356-b8e9-4161-980d-61cfa2579867 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] 10.222.0.65 "GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a" status: 200 len: 1356 microversion: 2.1 time: 0.156935 Aug 31 19:17:06.473880 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 326/647] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:17:06 2022] GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a => generated 1356 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:17:07.494720 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-3617090c-a77e-4e1b-8e94-573802d687fd tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:07.495341 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-3617090c-a77e-4e1b-8e94-573802d687fd tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] [instance: 5537ff84-8f70-4ba6-b219-09ffa1164d9a] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:17:07.502243 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3617090c-a77e-4e1b-8e94-573802d687fd tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:07.502720 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3617090c-a77e-4e1b-8e94-573802d687fd tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:07.503149 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3617090c-a77e-4e1b-8e94-573802d687fd tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:07.503833 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3617090c-a77e-4e1b-8e94-573802d687fd tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:07.504278 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3617090c-a77e-4e1b-8e94-573802d687fd tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:07.504692 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3617090c-a77e-4e1b-8e94-573802d687fd tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:07.639777 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-3617090c-a77e-4e1b-8e94-573802d687fd tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07fb9a216ac4683852fc6cae7c10b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8ee0bdd09b45599a7c19798660aac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:17:07.659378 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-3617090c-a77e-4e1b-8e94-573802d687fd tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] 10.222.0.65 "GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a" status: 200 len: 1356 microversion: 2.1 time: 0.168272 Aug 31 19:17:07.660055 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 327/648] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:17:07 2022] GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a => generated 1356 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:17:08.015196 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-910612a5-37be-449e-aaad-454bf2eef4d9 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] 10.222.0.65 "POST /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 12.623216 Aug 31 19:17:08.016212 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 322/649] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 31 19:16:55 2022] POST /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e/os-volume_attachments => generated 194 bytes in 12626 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:17:08.263363 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-bfa9874c-8925-428c-acb8-f3324ff23a9f req-8cabc3a4-68d9-41ba-b0cf-cfa5d7726996 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5537ff84-8f70-4ba6-b219-09ffa1164d9a", "tag": "ac12d0b7-5798-4d48-8cb0-9040f44c18b1"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:17:08.274211 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-bfa9874c-8925-428c-acb8-f3324ff23a9f req-8cabc3a4-68d9-41ba-b0cf-cfa5d7726996 service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:08.274691 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-bfa9874c-8925-428c-acb8-f3324ff23a9f req-8cabc3a4-68d9-41ba-b0cf-cfa5d7726996 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:08.275130 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-bfa9874c-8925-428c-acb8-f3324ff23a9f req-8cabc3a4-68d9-41ba-b0cf-cfa5d7726996 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:08.287182 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-bfa9874c-8925-428c-acb8-f3324ff23a9f req-8cabc3a4-68d9-41ba-b0cf-cfa5d7726996 service nova] Creating event network-changed:ac12d0b7-5798-4d48-8cb0-9040f44c18b1 for instance 5537ff84-8f70-4ba6-b219-09ffa1164d9a on hv-cinder-83538 Aug 31 19:17:08.292447 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-bfa9874c-8925-428c-acb8-f3324ff23a9f req-8cabc3a4-68d9-41ba-b0cf-cfa5d7726996 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032864 Aug 31 19:17:08.293036 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 328/650] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:17:08.683712 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-6e0fe28e-b048-430d-a9d3-5d4ef8edf1b3 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:08.684397 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-6e0fe28e-b048-430d-a9d3-5d4ef8edf1b3 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] [instance: 5537ff84-8f70-4ba6-b219-09ffa1164d9a] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:17:08.691410 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6e0fe28e-b048-430d-a9d3-5d4ef8edf1b3 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:08.691890 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6e0fe28e-b048-430d-a9d3-5d4ef8edf1b3 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:08.692311 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6e0fe28e-b048-430d-a9d3-5d4ef8edf1b3 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:08.693007 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6e0fe28e-b048-430d-a9d3-5d4ef8edf1b3 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:08.693479 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6e0fe28e-b048-430d-a9d3-5d4ef8edf1b3 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:08.693892 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6e0fe28e-b048-430d-a9d3-5d4ef8edf1b3 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:09.064418 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-6e0fe28e-b048-430d-a9d3-5d4ef8edf1b3 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07fb9a216ac4683852fc6cae7c10b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8ee0bdd09b45599a7c19798660aac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:17:09.072679 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-6e0fe28e-b048-430d-a9d3-5d4ef8edf1b3 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] 10.222.0.65 "GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a" status: 200 len: 1356 microversion: 2.1 time: 0.393444 Aug 31 19:17:09.073732 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 323/651] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:17:08 2022] GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a => generated 1356 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:17:10.094467 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-5962f661-95b7-49d1-a5b5-039ba71ad370 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:10.095189 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-5962f661-95b7-49d1-a5b5-039ba71ad370 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] [instance: 5537ff84-8f70-4ba6-b219-09ffa1164d9a] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:17:10.101352 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5962f661-95b7-49d1-a5b5-039ba71ad370 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:10.101839 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5962f661-95b7-49d1-a5b5-039ba71ad370 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:10.102268 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5962f661-95b7-49d1-a5b5-039ba71ad370 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:10.102952 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5962f661-95b7-49d1-a5b5-039ba71ad370 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:10.103676 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5962f661-95b7-49d1-a5b5-039ba71ad370 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:10.104097 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5962f661-95b7-49d1-a5b5-039ba71ad370 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:10.237768 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-5962f661-95b7-49d1-a5b5-039ba71ad370 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07fb9a216ac4683852fc6cae7c10b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8ee0bdd09b45599a7c19798660aac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:17:10.245296 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-5962f661-95b7-49d1-a5b5-039ba71ad370 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] 10.222.0.65 "GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a" status: 200 len: 1356 microversion: 2.1 time: 0.155530 Aug 31 19:17:10.245852 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 329/652] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:17:10 2022] GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a => generated 1356 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:17:11.266152 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-a516c251-1400-4338-8b32-a9f3901885be tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:11.266761 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-a516c251-1400-4338-8b32-a9f3901885be tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] [instance: 5537ff84-8f70-4ba6-b219-09ffa1164d9a] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:17:11.273468 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a516c251-1400-4338-8b32-a9f3901885be tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:11.273964 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a516c251-1400-4338-8b32-a9f3901885be tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:11.274397 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a516c251-1400-4338-8b32-a9f3901885be tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:11.275088 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a516c251-1400-4338-8b32-a9f3901885be tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:11.275545 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a516c251-1400-4338-8b32-a9f3901885be tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:11.275968 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a516c251-1400-4338-8b32-a9f3901885be tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:11.402315 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-a516c251-1400-4338-8b32-a9f3901885be tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07fb9a216ac4683852fc6cae7c10b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8ee0bdd09b45599a7c19798660aac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:17:11.409808 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-a516c251-1400-4338-8b32-a9f3901885be tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] 10.222.0.65 "GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a" status: 200 len: 1356 microversion: 2.1 time: 0.148042 Aug 31 19:17:11.410543 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 324/653] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:17:11 2022] GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a => generated 1356 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:17:12.430027 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-f23f9245-93a1-4636-b418-aa23e6d132c5 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:12.430777 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-f23f9245-93a1-4636-b418-aa23e6d132c5 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] [instance: 5537ff84-8f70-4ba6-b219-09ffa1164d9a] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:17:12.437303 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f23f9245-93a1-4636-b418-aa23e6d132c5 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:12.437819 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f23f9245-93a1-4636-b418-aa23e6d132c5 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:12.438254 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f23f9245-93a1-4636-b418-aa23e6d132c5 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:12.438947 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f23f9245-93a1-4636-b418-aa23e6d132c5 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:12.439401 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f23f9245-93a1-4636-b418-aa23e6d132c5 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:12.439817 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f23f9245-93a1-4636-b418-aa23e6d132c5 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:12.575560 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-f23f9245-93a1-4636-b418-aa23e6d132c5 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07fb9a216ac4683852fc6cae7c10b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8ee0bdd09b45599a7c19798660aac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:17:12.579602 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=100 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:17:12.584209 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-f23f9245-93a1-4636-b418-aa23e6d132c5 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] 10.222.0.65 "GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a" status: 200 len: 1356 microversion: 2.1 time: 0.158128 Aug 31 19:17:12.585431 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 330/654] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:17:12 2022] GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a => generated 1356 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:17:13.605757 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-fb6b4487-5591-4118-9c81-64fa1b81d2fe tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:13.606275 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-fb6b4487-5591-4118-9c81-64fa1b81d2fe tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] [instance: 5537ff84-8f70-4ba6-b219-09ffa1164d9a] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:17:13.613373 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fb6b4487-5591-4118-9c81-64fa1b81d2fe tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:13.613811 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fb6b4487-5591-4118-9c81-64fa1b81d2fe tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:13.614246 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fb6b4487-5591-4118-9c81-64fa1b81d2fe tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:13.614937 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fb6b4487-5591-4118-9c81-64fa1b81d2fe tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:13.615389 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fb6b4487-5591-4118-9c81-64fa1b81d2fe tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:13.615814 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fb6b4487-5591-4118-9c81-64fa1b81d2fe tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:13.750780 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-fb6b4487-5591-4118-9c81-64fa1b81d2fe tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07fb9a216ac4683852fc6cae7c10b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8ee0bdd09b45599a7c19798660aac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:17:13.759404 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-fb6b4487-5591-4118-9c81-64fa1b81d2fe tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] 10.222.0.65 "GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a" status: 200 len: 1356 microversion: 2.1 time: 0.157889 Aug 31 19:17:13.760226 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 325/655] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:17:13 2022] GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a => generated 1356 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:17:14.707926 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-0cf68cf2-a0ad-4190-afcb-a7d22f8a19dc req-efc28800-9251-499c-862f-e2f4006ce60b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5537ff84-8f70-4ba6-b219-09ffa1164d9a", "name": "network-vif-plugged", "status": "completed", "tag": "ac12d0b7-5798-4d48-8cb0-9040f44c18b1"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:17:14.719044 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-0cf68cf2-a0ad-4190-afcb-a7d22f8a19dc req-efc28800-9251-499c-862f-e2f4006ce60b service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:14.719544 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-0cf68cf2-a0ad-4190-afcb-a7d22f8a19dc req-efc28800-9251-499c-862f-e2f4006ce60b service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:14.719969 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-0cf68cf2-a0ad-4190-afcb-a7d22f8a19dc req-efc28800-9251-499c-862f-e2f4006ce60b service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:14.731666 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-0cf68cf2-a0ad-4190-afcb-a7d22f8a19dc req-efc28800-9251-499c-862f-e2f4006ce60b service nova] Creating event network-vif-plugged:ac12d0b7-5798-4d48-8cb0-9040f44c18b1 for instance 5537ff84-8f70-4ba6-b219-09ffa1164d9a on hv-cinder-83538 Aug 31 19:17:14.736567 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-0cf68cf2-a0ad-4190-afcb-a7d22f8a19dc req-efc28800-9251-499c-862f-e2f4006ce60b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032903 Aug 31 19:17:14.737486 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 331/656] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:17:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:17:14.779866 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-2936f6d7-0690-46ae-b873-b173ec7f4c54 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:14.780560 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-2936f6d7-0690-46ae-b873-b173ec7f4c54 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] [instance: 5537ff84-8f70-4ba6-b219-09ffa1164d9a] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:17:14.787508 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2936f6d7-0690-46ae-b873-b173ec7f4c54 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:14.787993 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2936f6d7-0690-46ae-b873-b173ec7f4c54 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:14.788430 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2936f6d7-0690-46ae-b873-b173ec7f4c54 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:14.789115 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2936f6d7-0690-46ae-b873-b173ec7f4c54 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:14.789601 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2936f6d7-0690-46ae-b873-b173ec7f4c54 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:14.790021 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2936f6d7-0690-46ae-b873-b173ec7f4c54 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:14.919020 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-2936f6d7-0690-46ae-b873-b173ec7f4c54 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07fb9a216ac4683852fc6cae7c10b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8ee0bdd09b45599a7c19798660aac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:17:14.930588 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-2936f6d7-0690-46ae-b873-b173ec7f4c54 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] 10.222.0.65 "GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a" status: 200 len: 1356 microversion: 2.1 time: 0.154448 Aug 31 19:17:14.931270 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 326/657] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:17:14 2022] GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a => generated 1356 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:17:15.571101 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-11fbd4a9-421b-45a7-b0ae-eaa43408a574 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Action: 'create', calling method: .version_select at 0x7fdb89c83dc0>, body: {"keypair": {"name": "tempest-keypair-1345825998", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNrLC9vvKBgOBCrjXvxvGa86buABT3I9er6N6zHEYUHtqYWjAmFHIXebxsSJY9nVmoUNphBBAEwr7HpYjH03mjL9dLnF/vADyjpCV5xKcf/WeEgn25MzS3Eh1rP5bshyQ=="}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:17:15.587672 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-11fbd4a9-421b-45a7-b0ae-eaa43408a574 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Getting quotas for project e6d782400f1e432c8d10a31334c42e68. Resources: {'key_pairs'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:17:15.591405 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-11fbd4a9-421b-45a7-b0ae-eaa43408a574 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Getting quotas for user 0bfa1533b0944bd681f4c2a33cf701b0 and project e6d782400f1e432c8d10a31334c42e68. Resources: {'key_pairs'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:17:15.613162 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-11fbd4a9-421b-45a7-b0ae-eaa43408a574 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046370 Aug 31 19:17:15.613767 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 332/658] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Aug 31 19:17:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:17:15.952101 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-426fe800-93ab-4b8b-9ea7-a6fce0cc99d4 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:15.953544 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-426fe800-93ab-4b8b-9ea7-a6fce0cc99d4 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] [instance: 5537ff84-8f70-4ba6-b219-09ffa1164d9a] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:17:15.959902 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-426fe800-93ab-4b8b-9ea7-a6fce0cc99d4 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:15.960384 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-426fe800-93ab-4b8b-9ea7-a6fce0cc99d4 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:15.960818 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-426fe800-93ab-4b8b-9ea7-a6fce0cc99d4 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:15.961539 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-426fe800-93ab-4b8b-9ea7-a6fce0cc99d4 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:15.961991 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-426fe800-93ab-4b8b-9ea7-a6fce0cc99d4 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:15.962442 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-426fe800-93ab-4b8b-9ea7-a6fce0cc99d4 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:16.106055 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-426fe800-93ab-4b8b-9ea7-a6fce0cc99d4 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07fb9a216ac4683852fc6cae7c10b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8ee0bdd09b45599a7c19798660aac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:17:16.113814 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-426fe800-93ab-4b8b-9ea7-a6fce0cc99d4 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] 10.222.0.65 "GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a" status: 200 len: 1356 microversion: 2.1 time: 0.165710 Aug 31 19:17:16.114400 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 327/659] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:17:15 2022] GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a => generated 1356 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:17:16.969850 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-16eb31c6-f8fa-4638-876b-2e480ad0f6a9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2142838236", "imageRef": "f4f2ae76-bacc-4449-881b-f697e1eeec66", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3d3f0557-9886-408b-a53b-c6736a0907d4"}], "security_groups": [{"name": "tempest-securitygroup--1520500229"}], "key_name": "tempest-keypair-1345825998", "user_data": "}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:17:17.083738 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.network.neutron [None req-16eb31c6-f8fa-4638-876b-2e480ad0f6a9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] validate_networks() for [('3d3f0557-9886-408b-a53b-c6736a0907d4', None, None, None, None, None)] {{(pid=120624) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:17:17.135836 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-3e3dbd23-cd29-4de0-9013-c76489c1c84b tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:17.136452 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-3e3dbd23-cd29-4de0-9013-c76489c1c84b tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] [instance: 5537ff84-8f70-4ba6-b219-09ffa1164d9a] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:17:17.143456 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3e3dbd23-cd29-4de0-9013-c76489c1c84b tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:17.143967 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3e3dbd23-cd29-4de0-9013-c76489c1c84b tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:17.144400 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3e3dbd23-cd29-4de0-9013-c76489c1c84b tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:17.145098 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3e3dbd23-cd29-4de0-9013-c76489c1c84b tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:17.145575 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3e3dbd23-cd29-4de0-9013-c76489c1c84b tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:17.145995 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3e3dbd23-cd29-4de0-9013-c76489c1c84b tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:17.275666 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-3e3dbd23-cd29-4de0-9013-c76489c1c84b tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07fb9a216ac4683852fc6cae7c10b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8ee0bdd09b45599a7c19798660aac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:17:17.283978 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-3e3dbd23-cd29-4de0-9013-c76489c1c84b tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] 10.222.0.65 "GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a" status: 200 len: 1545 microversion: 2.1 time: 0.151954 Aug 31 19:17:17.284546 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 328/660] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:17:17 2022] GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a => generated 1545 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:17:17.303555 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-28c61b32-eef5-4dbf-9926-bf0d79b26860 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:17.304163 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-28c61b32-eef5-4dbf-9926-bf0d79b26860 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] [instance: 5537ff84-8f70-4ba6-b219-09ffa1164d9a] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:17:17.309962 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-28c61b32-eef5-4dbf-9926-bf0d79b26860 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:17.310468 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-28c61b32-eef5-4dbf-9926-bf0d79b26860 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:17.310902 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-28c61b32-eef5-4dbf-9926-bf0d79b26860 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:17.311589 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-28c61b32-eef5-4dbf-9926-bf0d79b26860 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:17.312697 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-28c61b32-eef5-4dbf-9926-bf0d79b26860 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:17.313125 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-28c61b32-eef5-4dbf-9926-bf0d79b26860 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:17.446515 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-28c61b32-eef5-4dbf-9926-bf0d79b26860 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07fb9a216ac4683852fc6cae7c10b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8ee0bdd09b45599a7c19798660aac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:17:17.456082 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-28c61b32-eef5-4dbf-9926-bf0d79b26860 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] 10.222.0.65 "GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a" status: 200 len: 1545 microversion: 2.1 time: 0.156257 Aug 31 19:17:17.456669 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 329/661] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:17:17 2022] GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a => generated 1545 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:17:17.474662 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-16eb31c6-f8fa-4638-876b-2e480ad0f6a9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Flavor limits 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:17:17.475081 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-16eb31c6-f8fa-4638-876b-2e480ad0f6a9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Image limits 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:17:17.475584 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-16eb31c6-f8fa-4638-876b-2e480ad0f6a9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Flavor pref 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:17:17.475984 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-16eb31c6-f8fa-4638-876b-2e480ad0f6a9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Image pref 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:17:17.476505 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-c6758907-58c5-4913-8902-c181838fc97c tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:17.476625 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-16eb31c6-f8fa-4638-876b-2e480ad0f6a9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:17:17.481607 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-c6758907-58c5-4913-8902-c181838fc97c tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a07fb9a216ac4683852fc6cae7c10b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8ee0bdd09b45599a7c19798660aac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:17:17.482365 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-c6758907-58c5-4913-8902-c181838fc97c tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Searching by: {'deleted': False, 'project_id': 'fe8ee0bdd09b45599a7c19798660aac0'} {{(pid=120623) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 19:17:17.486117 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-16eb31c6-f8fa-4638-876b-2e480ad0f6a9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:17.486642 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-16eb31c6-f8fa-4638-876b-2e480ad0f6a9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:17.487066 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-16eb31c6-f8fa-4638-876b-2e480ad0f6a9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:17.487786 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-16eb31c6-f8fa-4638-876b-2e480ad0f6a9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:17.488233 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-16eb31c6-f8fa-4638-876b-2e480ad0f6a9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:17.488650 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-16eb31c6-f8fa-4638-876b-2e480ad0f6a9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:17.489480 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c6758907-58c5-4913-8902-c181838fc97c tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:17.489952 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c6758907-58c5-4913-8902-c181838fc97c tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:17.490375 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c6758907-58c5-4913-8902-c181838fc97c tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:17.491083 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c6758907-58c5-4913-8902-c181838fc97c tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:17.491530 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c6758907-58c5-4913-8902-c181838fc97c tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:17.491943 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c6758907-58c5-4913-8902-c181838fc97c tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:17.506177 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-16eb31c6-f8fa-4638-876b-2e480ad0f6a9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Getting quotas for project e6d782400f1e432c8d10a31334c42e68. Resources: {'instances', 'cores', 'ram'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:17:17.510680 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-16eb31c6-f8fa-4638-876b-2e480ad0f6a9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Getting quotas for user 0bfa1533b0944bd681f4c2a33cf701b0 and project e6d782400f1e432c8d10a31334c42e68. Resources: {'instances', 'cores', 'ram'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:17:17.521916 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-16eb31c6-f8fa-4638-876b-2e480ad0f6a9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Going to run 1 instances... {{(pid=120624) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:17:17.524295 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-16eb31c6-f8fa-4638-876b-2e480ad0f6a9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: f7d66e43-86cd-49c9-9bf0-09489b7fd178] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f4f2ae76-bacc-4449-881b-f697e1eeec66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120624) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:17:17.572440 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-16eb31c6-f8fa-4638-876b-2e480ad0f6a9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.608170 Aug 31 19:17:17.573087 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 333/662] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 31 19:17:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 19:17:17.583417 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-2002e70e-873f-404e-8f09-73d7971b8604 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:17.584019 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-2002e70e-873f-404e-8f09-73d7971b8604 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: f7d66e43-86cd-49c9-9bf0-09489b7fd178] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:17:17.591665 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.multi_cell_list [None req-c6758907-58c5-4913-8902-c181838fc97c tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120623) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 19:17:17.593052 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:17:17.662487 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-2002e70e-873f-404e-8f09-73d7971b8604 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:17:17.670336 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-2002e70e-873f-404e-8f09-73d7971b8604 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178" status: 200 len: 1242 microversion: 2.1 time: 0.090535 Aug 31 19:17:17.671204 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 334/663] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:17:17 2022] GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178 => generated 1242 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:17:17.709477 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-c6758907-58c5-4913-8902-c181838fc97c tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] 10.222.0.65 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.236704 Aug 31 19:17:17.710054 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 330/664] 10.222.0.65 () {58 vars in 1125 bytes} [Wed Aug 31 19:17:17 2022] GET /compute/v2.1/servers => generated 343 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:17:17.721853 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-62f6be92-53a0-4a54-adf3-f31c2298c8ec tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:17.722550 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-62f6be92-53a0-4a54-adf3-f31c2298c8ec tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] [instance: 5537ff84-8f70-4ba6-b219-09ffa1164d9a] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:17:17.729964 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-62f6be92-53a0-4a54-adf3-f31c2298c8ec tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:17.730526 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-62f6be92-53a0-4a54-adf3-f31c2298c8ec tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:17.730935 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-62f6be92-53a0-4a54-adf3-f31c2298c8ec tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:17.731553 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-62f6be92-53a0-4a54-adf3-f31c2298c8ec tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:17.732007 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-62f6be92-53a0-4a54-adf3-f31c2298c8ec tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:17.732430 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-62f6be92-53a0-4a54-adf3-f31c2298c8ec tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:17.875224 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-62f6be92-53a0-4a54-adf3-f31c2298c8ec tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07fb9a216ac4683852fc6cae7c10b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8ee0bdd09b45599a7c19798660aac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:17:17.885290 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-62f6be92-53a0-4a54-adf3-f31c2298c8ec tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] 10.222.0.65 "GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a" status: 200 len: 1545 microversion: 2.1 time: 0.167799 Aug 31 19:17:17.885875 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 335/665] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:17:17 2022] GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a => generated 1545 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:17:18.690928 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-84d304f1-ebdd-43d5-b5ea-ced70af6f391 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:18.691641 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-84d304f1-ebdd-43d5-b5ea-ced70af6f391 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: f7d66e43-86cd-49c9-9bf0-09489b7fd178] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:17:18.698048 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-84d304f1-ebdd-43d5-b5ea-ced70af6f391 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:18.698566 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-84d304f1-ebdd-43d5-b5ea-ced70af6f391 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:18.698995 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-84d304f1-ebdd-43d5-b5ea-ced70af6f391 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:18.699675 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-84d304f1-ebdd-43d5-b5ea-ced70af6f391 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:18.700123 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-84d304f1-ebdd-43d5-b5ea-ced70af6f391 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:18.700539 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-84d304f1-ebdd-43d5-b5ea-ced70af6f391 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:18.763053 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-84d304f1-ebdd-43d5-b5ea-ced70af6f391 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:17:18.771994 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-84d304f1-ebdd-43d5-b5ea-ced70af6f391 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178" status: 200 len: 1294 microversion: 2.1 time: 0.085204 Aug 31 19:17:18.772555 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 331/666] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:17:18 2022] GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178 => generated 1294 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:17:19.438955 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-5a27dde3-8f82-4318-b33c-22465ebfba85 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "12c985f7-d940-466c-8b3e-dd3caabfc3b0"}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:17:19.441481 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-5a27dde3-8f82-4318-b33c-22465ebfba85 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] [instance: 5537ff84-8f70-4ba6-b219-09ffa1164d9a] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:17:19.448156 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5a27dde3-8f82-4318-b33c-22465ebfba85 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:19.448632 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5a27dde3-8f82-4318-b33c-22465ebfba85 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:19.449056 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5a27dde3-8f82-4318-b33c-22465ebfba85 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:19.449765 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5a27dde3-8f82-4318-b33c-22465ebfba85 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:19.450204 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5a27dde3-8f82-4318-b33c-22465ebfba85 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:19.450612 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5a27dde3-8f82-4318-b33c-22465ebfba85 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:19.756552 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-5a27dde3-8f82-4318-b33c-22465ebfba85 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] 10.222.0.65 "POST /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.322023 Aug 31 19:17:19.757558 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 336/667] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 31 19:17:19 2022] POST /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a/os-volume_attachments => generated 194 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:17:19.794731 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-c0abf54f-4502-429e-871e-e280b0ee235e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:19.799743 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-c0abf54f-4502-429e-871e-e280b0ee235e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: f7d66e43-86cd-49c9-9bf0-09489b7fd178] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:17:19.808456 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c0abf54f-4502-429e-871e-e280b0ee235e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:19.809315 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c0abf54f-4502-429e-871e-e280b0ee235e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:19.809954 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c0abf54f-4502-429e-871e-e280b0ee235e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:19.811038 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c0abf54f-4502-429e-871e-e280b0ee235e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:19.811727 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c0abf54f-4502-429e-871e-e280b0ee235e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:19.812616 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c0abf54f-4502-429e-871e-e280b0ee235e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:20.069690 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-c0abf54f-4502-429e-871e-e280b0ee235e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:17:20.078123 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-c0abf54f-4502-429e-871e-e280b0ee235e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178" status: 200 len: 1368 microversion: 2.1 time: 0.287858 Aug 31 19:17:20.078858 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 332/668] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:17:19 2022] GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178 => generated 1368 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:17:20.451994 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-eb8f41a1-98df-4e31-8739-1eaf0a7f7083 req-c84effa7-c0c4-4b37-bb51-25f0f90d9d48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7d66e43-86cd-49c9-9bf0-09489b7fd178", "tag": "29dfcfdc-0475-40e4-a4ec-d26e3026aa4a"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:17:20.462317 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-eb8f41a1-98df-4e31-8739-1eaf0a7f7083 req-c84effa7-c0c4-4b37-bb51-25f0f90d9d48 service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:20.462802 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-eb8f41a1-98df-4e31-8739-1eaf0a7f7083 req-c84effa7-c0c4-4b37-bb51-25f0f90d9d48 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:20.463231 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-eb8f41a1-98df-4e31-8739-1eaf0a7f7083 req-c84effa7-c0c4-4b37-bb51-25f0f90d9d48 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:20.474671 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-eb8f41a1-98df-4e31-8739-1eaf0a7f7083 req-c84effa7-c0c4-4b37-bb51-25f0f90d9d48 service nova] Creating event network-changed:29dfcfdc-0475-40e4-a4ec-d26e3026aa4a for instance f7d66e43-86cd-49c9-9bf0-09489b7fd178 on hv-cinder-83538 Aug 31 19:17:20.479562 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-eb8f41a1-98df-4e31-8739-1eaf0a7f7083 req-c84effa7-c0c4-4b37-bb51-25f0f90d9d48 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031777 Aug 31 19:17:20.480177 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 337/669] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:17:21.098976 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-23de92b6-cb48-4450-b32e-a94a015e850a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:21.099510 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-23de92b6-cb48-4450-b32e-a94a015e850a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: f7d66e43-86cd-49c9-9bf0-09489b7fd178] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:17:21.106088 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-23de92b6-cb48-4450-b32e-a94a015e850a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:21.106573 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-23de92b6-cb48-4450-b32e-a94a015e850a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:21.107015 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-23de92b6-cb48-4450-b32e-a94a015e850a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:21.107702 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-23de92b6-cb48-4450-b32e-a94a015e850a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:21.108155 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-23de92b6-cb48-4450-b32e-a94a015e850a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:21.108592 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-23de92b6-cb48-4450-b32e-a94a015e850a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:21.239930 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-23de92b6-cb48-4450-b32e-a94a015e850a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:17:21.247502 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-23de92b6-cb48-4450-b32e-a94a015e850a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178" status: 200 len: 1368 microversion: 2.1 time: 0.152457 Aug 31 19:17:21.248088 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 333/670] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:17:21 2022] GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:17:22.268940 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-866dfb20-0c4a-4589-83d3-57e22c5aec46 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:22.269653 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-866dfb20-0c4a-4589-83d3-57e22c5aec46 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: f7d66e43-86cd-49c9-9bf0-09489b7fd178] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:17:22.275703 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-866dfb20-0c4a-4589-83d3-57e22c5aec46 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:22.276171 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-866dfb20-0c4a-4589-83d3-57e22c5aec46 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:22.276591 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-866dfb20-0c4a-4589-83d3-57e22c5aec46 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:22.277293 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-866dfb20-0c4a-4589-83d3-57e22c5aec46 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:22.277763 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-866dfb20-0c4a-4589-83d3-57e22c5aec46 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:22.278172 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-866dfb20-0c4a-4589-83d3-57e22c5aec46 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:22.408016 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-866dfb20-0c4a-4589-83d3-57e22c5aec46 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:17:22.416281 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-866dfb20-0c4a-4589-83d3-57e22c5aec46 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178" status: 200 len: 1368 microversion: 2.1 time: 0.152034 Aug 31 19:17:22.416845 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 338/671] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:17:22 2022] GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:17:23.436450 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-f5641916-3d10-46ba-8f5d-6f86b20e153f tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:23.437031 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-f5641916-3d10-46ba-8f5d-6f86b20e153f tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: f7d66e43-86cd-49c9-9bf0-09489b7fd178] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:17:23.443243 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f5641916-3d10-46ba-8f5d-6f86b20e153f tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:23.443723 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f5641916-3d10-46ba-8f5d-6f86b20e153f tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:23.444153 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f5641916-3d10-46ba-8f5d-6f86b20e153f tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:23.444837 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f5641916-3d10-46ba-8f5d-6f86b20e153f tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:23.445311 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f5641916-3d10-46ba-8f5d-6f86b20e153f tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:23.445733 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f5641916-3d10-46ba-8f5d-6f86b20e153f tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:23.572529 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-f5641916-3d10-46ba-8f5d-6f86b20e153f tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:17:23.580305 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-f5641916-3d10-46ba-8f5d-6f86b20e153f tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178" status: 200 len: 1368 microversion: 2.1 time: 0.147739 Aug 31 19:17:23.580869 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 334/672] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:17:23 2022] GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178 => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:17:24.600469 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-5b86067b-8ece-432f-a658-808ea40e3963 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:24.601076 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-5b86067b-8ece-432f-a658-808ea40e3963 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: f7d66e43-86cd-49c9-9bf0-09489b7fd178] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:17:24.607916 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5b86067b-8ece-432f-a658-808ea40e3963 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:24.608394 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5b86067b-8ece-432f-a658-808ea40e3963 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:24.608823 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5b86067b-8ece-432f-a658-808ea40e3963 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:24.609543 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5b86067b-8ece-432f-a658-808ea40e3963 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:24.609992 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5b86067b-8ece-432f-a658-808ea40e3963 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:24.610407 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5b86067b-8ece-432f-a658-808ea40e3963 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:24.741580 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-5b86067b-8ece-432f-a658-808ea40e3963 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:17:24.749760 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-5b86067b-8ece-432f-a658-808ea40e3963 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178" status: 200 len: 1368 microversion: 2.1 time: 0.153288 Aug 31 19:17:24.750325 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 339/673] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:17:24 2022] GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:17:25.770237 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-2ee78d12-3bf9-4ce5-ac7c-f99e2b4fc3c1 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:25.770839 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-2ee78d12-3bf9-4ce5-ac7c-f99e2b4fc3c1 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: f7d66e43-86cd-49c9-9bf0-09489b7fd178] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:17:25.777310 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2ee78d12-3bf9-4ce5-ac7c-f99e2b4fc3c1 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:25.777789 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2ee78d12-3bf9-4ce5-ac7c-f99e2b4fc3c1 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:25.778279 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2ee78d12-3bf9-4ce5-ac7c-f99e2b4fc3c1 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:25.778966 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2ee78d12-3bf9-4ce5-ac7c-f99e2b4fc3c1 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:25.779420 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2ee78d12-3bf9-4ce5-ac7c-f99e2b4fc3c1 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:25.779826 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2ee78d12-3bf9-4ce5-ac7c-f99e2b4fc3c1 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:25.916120 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-2ee78d12-3bf9-4ce5-ac7c-f99e2b4fc3c1 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:17:25.924472 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-2ee78d12-3bf9-4ce5-ac7c-f99e2b4fc3c1 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178" status: 200 len: 1368 microversion: 2.1 time: 0.158028 Aug 31 19:17:25.925037 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 335/674] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:17:25 2022] GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:17:26.945104 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-670d9f4e-11f4-4abf-b8d6-7b27b6dc0f7d tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:26.945731 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-670d9f4e-11f4-4abf-b8d6-7b27b6dc0f7d tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: f7d66e43-86cd-49c9-9bf0-09489b7fd178] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:17:26.952023 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-670d9f4e-11f4-4abf-b8d6-7b27b6dc0f7d tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:26.952544 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-670d9f4e-11f4-4abf-b8d6-7b27b6dc0f7d tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:26.952964 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-670d9f4e-11f4-4abf-b8d6-7b27b6dc0f7d tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:26.953672 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-670d9f4e-11f4-4abf-b8d6-7b27b6dc0f7d tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:26.954118 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-670d9f4e-11f4-4abf-b8d6-7b27b6dc0f7d tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:26.954529 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-670d9f4e-11f4-4abf-b8d6-7b27b6dc0f7d tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:27.084734 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-670d9f4e-11f4-4abf-b8d6-7b27b6dc0f7d tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:17:27.092330 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-670d9f4e-11f4-4abf-b8d6-7b27b6dc0f7d tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178" status: 200 len: 1368 microversion: 2.1 time: 0.151389 Aug 31 19:17:27.093409 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 340/675] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:17:26 2022] GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:17:28.114060 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d8e82d56-a9ee-4b87-b3e6-afe3c235daf9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:28.114665 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d8e82d56-a9ee-4b87-b3e6-afe3c235daf9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: f7d66e43-86cd-49c9-9bf0-09489b7fd178] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:17:28.117103 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell0:SELECT=2 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:17:28.122472 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d8e82d56-a9ee-4b87-b3e6-afe3c235daf9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:28.122955 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d8e82d56-a9ee-4b87-b3e6-afe3c235daf9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:28.123421 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d8e82d56-a9ee-4b87-b3e6-afe3c235daf9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:28.124107 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d8e82d56-a9ee-4b87-b3e6-afe3c235daf9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:28.124559 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d8e82d56-a9ee-4b87-b3e6-afe3c235daf9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:28.124982 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d8e82d56-a9ee-4b87-b3e6-afe3c235daf9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:28.254631 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-d8e82d56-a9ee-4b87-b3e6-afe3c235daf9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:17:28.262249 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-d8e82d56-a9ee-4b87-b3e6-afe3c235daf9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178" status: 200 len: 1368 microversion: 2.1 time: 0.152050 Aug 31 19:17:28.262807 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 336/676] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:17:28 2022] GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:17:29.283523 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-ba17b820-9bb2-4798-bcfa-89c0589caf70 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:29.284064 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-ba17b820-9bb2-4798-bcfa-89c0589caf70 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: f7d66e43-86cd-49c9-9bf0-09489b7fd178] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:17:29.286006 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell0:SELECT=2 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:17:29.286826 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell0:SELECT=12 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:17:29.292651 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ba17b820-9bb2-4798-bcfa-89c0589caf70 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:29.293128 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ba17b820-9bb2-4798-bcfa-89c0589caf70 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:29.293583 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ba17b820-9bb2-4798-bcfa-89c0589caf70 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:29.294267 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ba17b820-9bb2-4798-bcfa-89c0589caf70 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:29.294714 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ba17b820-9bb2-4798-bcfa-89c0589caf70 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:29.295128 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ba17b820-9bb2-4798-bcfa-89c0589caf70 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:29.422932 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-ba17b820-9bb2-4798-bcfa-89c0589caf70 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:17:29.430508 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-ba17b820-9bb2-4798-bcfa-89c0589caf70 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178" status: 200 len: 1368 microversion: 2.1 time: 0.150990 Aug 31 19:17:29.431062 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 341/677] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:17:29 2022] GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:17:30.450273 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e1a45829-0129-41a0-b6ce-a57b5907a50d tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:30.450971 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-e1a45829-0129-41a0-b6ce-a57b5907a50d tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: f7d66e43-86cd-49c9-9bf0-09489b7fd178] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:17:30.457466 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e1a45829-0129-41a0-b6ce-a57b5907a50d tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:30.458046 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e1a45829-0129-41a0-b6ce-a57b5907a50d tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:30.458553 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e1a45829-0129-41a0-b6ce-a57b5907a50d tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:30.459247 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e1a45829-0129-41a0-b6ce-a57b5907a50d tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:30.459697 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e1a45829-0129-41a0-b6ce-a57b5907a50d tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:30.460121 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e1a45829-0129-41a0-b6ce-a57b5907a50d tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:30.594513 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e1a45829-0129-41a0-b6ce-a57b5907a50d tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:17:30.597906 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:17:30.602460 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-e1a45829-0129-41a0-b6ce-a57b5907a50d tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178" status: 200 len: 1368 microversion: 2.1 time: 0.155904 Aug 31 19:17:30.603273 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 337/678] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:17:30 2022] GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:17:31.161102 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-e1ccdd9b-c209-4555-ad26-6e0cfabc4d07 req-ea915748-6e49-45b1-9d6f-7fb4d6c816ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7d66e43-86cd-49c9-9bf0-09489b7fd178", "name": "network-vif-plugged", "status": "completed", "tag": "29dfcfdc-0475-40e4-a4ec-d26e3026aa4a"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:17:31.171136 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-e1ccdd9b-c209-4555-ad26-6e0cfabc4d07 req-ea915748-6e49-45b1-9d6f-7fb4d6c816ee service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:31.171617 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-e1ccdd9b-c209-4555-ad26-6e0cfabc4d07 req-ea915748-6e49-45b1-9d6f-7fb4d6c816ee service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:31.172646 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-e1ccdd9b-c209-4555-ad26-6e0cfabc4d07 req-ea915748-6e49-45b1-9d6f-7fb4d6c816ee service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:31.186084 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-e1ccdd9b-c209-4555-ad26-6e0cfabc4d07 req-ea915748-6e49-45b1-9d6f-7fb4d6c816ee service nova] Creating event network-vif-plugged:29dfcfdc-0475-40e4-a4ec-d26e3026aa4a for instance f7d66e43-86cd-49c9-9bf0-09489b7fd178 on hv-cinder-83538 Aug 31 19:17:31.191173 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-e1ccdd9b-c209-4555-ad26-6e0cfabc4d07 req-ea915748-6e49-45b1-9d6f-7fb4d6c816ee service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034474 Aug 31 19:17:31.192057 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 342/679] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:17:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:17:31.624688 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-ade40424-8ea7-4745-87a4-93d4803cc1a7 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:31.625965 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-ade40424-8ea7-4745-87a4-93d4803cc1a7 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: f7d66e43-86cd-49c9-9bf0-09489b7fd178] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:17:31.633399 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ade40424-8ea7-4745-87a4-93d4803cc1a7 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:31.633893 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ade40424-8ea7-4745-87a4-93d4803cc1a7 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:31.634315 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ade40424-8ea7-4745-87a4-93d4803cc1a7 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:31.635007 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ade40424-8ea7-4745-87a4-93d4803cc1a7 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:31.635454 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ade40424-8ea7-4745-87a4-93d4803cc1a7 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:31.635878 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ade40424-8ea7-4745-87a4-93d4803cc1a7 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:31.777970 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-ade40424-8ea7-4745-87a4-93d4803cc1a7 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:17:31.785506 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-ade40424-8ea7-4745-87a4-93d4803cc1a7 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178" status: 200 len: 1368 microversion: 2.1 time: 0.165736 Aug 31 19:17:31.786067 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 338/680] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:17:31 2022] GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:17:32.806893 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-1b7fe7fb-86e2-472c-8efd-0de5f92cb8bd tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:32.807577 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-1b7fe7fb-86e2-472c-8efd-0de5f92cb8bd tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: f7d66e43-86cd-49c9-9bf0-09489b7fd178] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:17:32.813611 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1b7fe7fb-86e2-472c-8efd-0de5f92cb8bd tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:32.814079 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1b7fe7fb-86e2-472c-8efd-0de5f92cb8bd tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:32.814500 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1b7fe7fb-86e2-472c-8efd-0de5f92cb8bd tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:32.815171 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1b7fe7fb-86e2-472c-8efd-0de5f92cb8bd tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:32.815610 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1b7fe7fb-86e2-472c-8efd-0de5f92cb8bd tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:32.816019 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1b7fe7fb-86e2-472c-8efd-0de5f92cb8bd tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:32.943014 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-1b7fe7fb-86e2-472c-8efd-0de5f92cb8bd tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:17:32.950513 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-1b7fe7fb-86e2-472c-8efd-0de5f92cb8bd tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178" status: 200 len: 1368 microversion: 2.1 time: 0.148273 Aug 31 19:17:32.951074 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 343/681] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:17:32 2022] GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178 => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:17:33.971384 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-2f1bca3e-f41c-4436-93df-f0c02100eec7 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:33.971928 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-2f1bca3e-f41c-4436-93df-f0c02100eec7 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: f7d66e43-86cd-49c9-9bf0-09489b7fd178] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:17:33.978728 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2f1bca3e-f41c-4436-93df-f0c02100eec7 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:33.979210 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2f1bca3e-f41c-4436-93df-f0c02100eec7 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:33.979643 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2f1bca3e-f41c-4436-93df-f0c02100eec7 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:33.980334 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2f1bca3e-f41c-4436-93df-f0c02100eec7 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:33.980788 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2f1bca3e-f41c-4436-93df-f0c02100eec7 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:33.981239 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2f1bca3e-f41c-4436-93df-f0c02100eec7 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:34.107826 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-2f1bca3e-f41c-4436-93df-f0c02100eec7 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:17:34.115943 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-2f1bca3e-f41c-4436-93df-f0c02100eec7 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178" status: 200 len: 1368 microversion: 2.1 time: 0.149108 Aug 31 19:17:34.116495 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 339/682] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:17:33 2022] GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178 => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:17:35.135944 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-da1085bb-8c4f-4a39-8ed3-f63736dba47f tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:35.136563 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-da1085bb-8c4f-4a39-8ed3-f63736dba47f tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: f7d66e43-86cd-49c9-9bf0-09489b7fd178] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:17:35.143055 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-da1085bb-8c4f-4a39-8ed3-f63736dba47f tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:35.143538 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-da1085bb-8c4f-4a39-8ed3-f63736dba47f tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:35.143970 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-da1085bb-8c4f-4a39-8ed3-f63736dba47f tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:35.144663 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-da1085bb-8c4f-4a39-8ed3-f63736dba47f tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:35.145117 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-da1085bb-8c4f-4a39-8ed3-f63736dba47f tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:35.145566 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-da1085bb-8c4f-4a39-8ed3-f63736dba47f tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:35.276713 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-da1085bb-8c4f-4a39-8ed3-f63736dba47f tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:17:35.285409 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-da1085bb-8c4f-4a39-8ed3-f63736dba47f tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178" status: 200 len: 1368 microversion: 2.1 time: 0.153193 Aug 31 19:17:35.285986 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 344/683] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:17:35 2022] GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:17:36.306135 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-3153b4dc-e11a-47df-9cb6-2afab5c31edf tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:36.306735 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-3153b4dc-e11a-47df-9cb6-2afab5c31edf tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: f7d66e43-86cd-49c9-9bf0-09489b7fd178] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:17:36.309016 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=35 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:17:36.314657 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3153b4dc-e11a-47df-9cb6-2afab5c31edf tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:36.315134 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3153b4dc-e11a-47df-9cb6-2afab5c31edf tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:36.315568 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3153b4dc-e11a-47df-9cb6-2afab5c31edf tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:36.316249 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3153b4dc-e11a-47df-9cb6-2afab5c31edf tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:36.316792 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3153b4dc-e11a-47df-9cb6-2afab5c31edf tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:36.317231 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3153b4dc-e11a-47df-9cb6-2afab5c31edf tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:36.442842 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-3153b4dc-e11a-47df-9cb6-2afab5c31edf tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:17:36.450387 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-3153b4dc-e11a-47df-9cb6-2afab5c31edf tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178" status: 200 len: 1368 microversion: 2.1 time: 0.148091 Aug 31 19:17:36.450953 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 340/684] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:17:36 2022] GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178 => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:17:37.471330 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-58d12051-d5d2-44a9-b0ec-50640b0b961e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:37.471871 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-58d12051-d5d2-44a9-b0ec-50640b0b961e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: f7d66e43-86cd-49c9-9bf0-09489b7fd178] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:17:37.478542 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-58d12051-d5d2-44a9-b0ec-50640b0b961e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:37.479017 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-58d12051-d5d2-44a9-b0ec-50640b0b961e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:37.479438 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-58d12051-d5d2-44a9-b0ec-50640b0b961e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:37.480111 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-58d12051-d5d2-44a9-b0ec-50640b0b961e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:37.480552 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-58d12051-d5d2-44a9-b0ec-50640b0b961e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:37.480961 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-58d12051-d5d2-44a9-b0ec-50640b0b961e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:37.620945 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-58d12051-d5d2-44a9-b0ec-50640b0b961e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:17:37.629163 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-58d12051-d5d2-44a9-b0ec-50640b0b961e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178" status: 200 len: 1368 microversion: 2.1 time: 0.162440 Aug 31 19:17:37.629756 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 345/685] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:17:37 2022] GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178 => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:17:38.650669 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e81022a1-abf7-4a48-8bc4-0ae332f97d0c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:38.651280 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-e81022a1-abf7-4a48-8bc4-0ae332f97d0c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: f7d66e43-86cd-49c9-9bf0-09489b7fd178] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:17:38.658360 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e81022a1-abf7-4a48-8bc4-0ae332f97d0c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:38.658871 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e81022a1-abf7-4a48-8bc4-0ae332f97d0c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:38.659303 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e81022a1-abf7-4a48-8bc4-0ae332f97d0c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:38.659989 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e81022a1-abf7-4a48-8bc4-0ae332f97d0c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:38.660440 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e81022a1-abf7-4a48-8bc4-0ae332f97d0c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:38.660862 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e81022a1-abf7-4a48-8bc4-0ae332f97d0c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:39.014957 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e81022a1-abf7-4a48-8bc4-0ae332f97d0c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:17:39.023145 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-e81022a1-abf7-4a48-8bc4-0ae332f97d0c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178" status: 200 len: 1368 microversion: 2.1 time: 0.376368 Aug 31 19:17:39.023717 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 341/686] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:17:38 2022] GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178 => generated 1368 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:17:40.043882 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-9c296a2c-93ca-402d-a7a7-606276f0fa11 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:40.044490 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-9c296a2c-93ca-402d-a7a7-606276f0fa11 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: f7d66e43-86cd-49c9-9bf0-09489b7fd178] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:17:40.051771 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9c296a2c-93ca-402d-a7a7-606276f0fa11 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:40.052291 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9c296a2c-93ca-402d-a7a7-606276f0fa11 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:40.052722 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9c296a2c-93ca-402d-a7a7-606276f0fa11 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:40.053493 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9c296a2c-93ca-402d-a7a7-606276f0fa11 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:40.053935 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9c296a2c-93ca-402d-a7a7-606276f0fa11 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:40.054347 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9c296a2c-93ca-402d-a7a7-606276f0fa11 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:40.186237 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-9c296a2c-93ca-402d-a7a7-606276f0fa11 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:17:40.194157 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-9c296a2c-93ca-402d-a7a7-606276f0fa11 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178" status: 200 len: 1368 microversion: 2.1 time: 0.153983 Aug 31 19:17:40.194832 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 346/687] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:17:40 2022] GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:17:41.215412 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d96cb99a-07b7-43fa-8681-21dba6f65736 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:41.216659 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d96cb99a-07b7-43fa-8681-21dba6f65736 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: f7d66e43-86cd-49c9-9bf0-09489b7fd178] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:17:41.222795 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d96cb99a-07b7-43fa-8681-21dba6f65736 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:41.223257 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d96cb99a-07b7-43fa-8681-21dba6f65736 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:41.223692 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d96cb99a-07b7-43fa-8681-21dba6f65736 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:41.224387 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d96cb99a-07b7-43fa-8681-21dba6f65736 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:41.224841 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d96cb99a-07b7-43fa-8681-21dba6f65736 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:41.225296 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d96cb99a-07b7-43fa-8681-21dba6f65736 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:41.357561 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-d96cb99a-07b7-43fa-8681-21dba6f65736 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:17:41.365655 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-d96cb99a-07b7-43fa-8681-21dba6f65736 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178" status: 200 len: 1368 microversion: 2.1 time: 0.154028 Aug 31 19:17:41.366211 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 342/688] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:17:41 2022] GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:17:42.385891 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-b24409d8-5fa4-450b-b449-f4c814398fad tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:42.386429 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-b24409d8-5fa4-450b-b449-f4c814398fad tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: f7d66e43-86cd-49c9-9bf0-09489b7fd178] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:17:42.393469 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b24409d8-5fa4-450b-b449-f4c814398fad tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:42.394062 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b24409d8-5fa4-450b-b449-f4c814398fad tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:42.394493 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b24409d8-5fa4-450b-b449-f4c814398fad tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:42.395176 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b24409d8-5fa4-450b-b449-f4c814398fad tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:42.395622 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b24409d8-5fa4-450b-b449-f4c814398fad tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:42.396040 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b24409d8-5fa4-450b-b449-f4c814398fad tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:42.526206 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-b24409d8-5fa4-450b-b449-f4c814398fad tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:17:42.533888 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-b24409d8-5fa4-450b-b449-f4c814398fad tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178" status: 200 len: 1368 microversion: 2.1 time: 0.151900 Aug 31 19:17:42.534444 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 347/689] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:17:42 2022] GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:17:43.555830 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-0a2546c0-8cdd-418e-a305-9fc21f7e1954 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:43.556437 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-0a2546c0-8cdd-418e-a305-9fc21f7e1954 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: f7d66e43-86cd-49c9-9bf0-09489b7fd178] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:17:43.563018 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0a2546c0-8cdd-418e-a305-9fc21f7e1954 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:43.563991 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0a2546c0-8cdd-418e-a305-9fc21f7e1954 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:43.564418 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0a2546c0-8cdd-418e-a305-9fc21f7e1954 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:43.565097 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0a2546c0-8cdd-418e-a305-9fc21f7e1954 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:43.565568 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0a2546c0-8cdd-418e-a305-9fc21f7e1954 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:43.565980 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0a2546c0-8cdd-418e-a305-9fc21f7e1954 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:43.695669 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-0a2546c0-8cdd-418e-a305-9fc21f7e1954 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:17:43.703171 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-0a2546c0-8cdd-418e-a305-9fc21f7e1954 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178" status: 200 len: 1368 microversion: 2.1 time: 0.152020 Aug 31 19:17:43.703923 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 343/690] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:17:43 2022] GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:17:44.726102 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-07f20ea8-2314-468e-b249-b04dfd9b21c3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:44.727004 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-07f20ea8-2314-468e-b249-b04dfd9b21c3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: f7d66e43-86cd-49c9-9bf0-09489b7fd178] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:17:44.733671 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-07f20ea8-2314-468e-b249-b04dfd9b21c3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:44.734155 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-07f20ea8-2314-468e-b249-b04dfd9b21c3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:44.734583 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-07f20ea8-2314-468e-b249-b04dfd9b21c3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:44.735273 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-07f20ea8-2314-468e-b249-b04dfd9b21c3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:44.735723 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-07f20ea8-2314-468e-b249-b04dfd9b21c3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:44.736139 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-07f20ea8-2314-468e-b249-b04dfd9b21c3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:44.740258 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:17:44.868352 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-07f20ea8-2314-468e-b249-b04dfd9b21c3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:17:44.876024 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-07f20ea8-2314-468e-b249-b04dfd9b21c3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178" status: 200 len: 1557 microversion: 2.1 time: 0.153825 Aug 31 19:17:44.876576 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 348/691] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:17:44 2022] GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178 => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:17:44.895851 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-01bc9ee2-a90b-4f99-a6e7-f51fc5d03b1e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:44.896342 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-01bc9ee2-a90b-4f99-a6e7-f51fc5d03b1e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: f7d66e43-86cd-49c9-9bf0-09489b7fd178] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:17:44.902681 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-01bc9ee2-a90b-4f99-a6e7-f51fc5d03b1e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:44.903156 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-01bc9ee2-a90b-4f99-a6e7-f51fc5d03b1e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:44.903585 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-01bc9ee2-a90b-4f99-a6e7-f51fc5d03b1e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:44.904257 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-01bc9ee2-a90b-4f99-a6e7-f51fc5d03b1e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:44.904703 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-01bc9ee2-a90b-4f99-a6e7-f51fc5d03b1e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:44.905118 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-01bc9ee2-a90b-4f99-a6e7-f51fc5d03b1e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:44.981750 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-01bc9ee2-a90b-4f99-a6e7-f51fc5d03b1e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090053 Aug 31 19:17:44.982331 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 344/692] 10.222.0.65 () {58 vars in 1275 bytes} [Wed Aug 31 19:17:44 2022] GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:17:45.349723 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-b2e1a6b5-b86c-45e9-98ae-ac78835474eb tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:45.350327 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-b2e1a6b5-b86c-45e9-98ae-ac78835474eb tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] [instance: 5537ff84-8f70-4ba6-b219-09ffa1164d9a] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:17:45.356510 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b2e1a6b5-b86c-45e9-98ae-ac78835474eb tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:45.356997 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b2e1a6b5-b86c-45e9-98ae-ac78835474eb tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:45.357450 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b2e1a6b5-b86c-45e9-98ae-ac78835474eb tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:45.358131 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b2e1a6b5-b86c-45e9-98ae-ac78835474eb tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:45.358580 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b2e1a6b5-b86c-45e9-98ae-ac78835474eb tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:45.358994 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b2e1a6b5-b86c-45e9-98ae-ac78835474eb tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:45.506168 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-b2e1a6b5-b86c-45e9-98ae-ac78835474eb tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07fb9a216ac4683852fc6cae7c10b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8ee0bdd09b45599a7c19798660aac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:17:45.514235 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-b2e1a6b5-b86c-45e9-98ae-ac78835474eb tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] 10.222.0.65 "GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a" status: 200 len: 1591 microversion: 2.1 time: 0.168338 Aug 31 19:17:45.514803 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 349/693] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:17:45 2022] GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a => generated 1591 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:17:46.047420 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-d01ed9d6-02ea-4dd7-80df-a4f020f400d8 req-5b12b87d-5af7-40a5-bd4e-d39679d94254 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7d66e43-86cd-49c9-9bf0-09489b7fd178", "tag": "29dfcfdc-0475-40e4-a4ec-d26e3026aa4a"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:17:46.057492 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-d01ed9d6-02ea-4dd7-80df-a4f020f400d8 req-5b12b87d-5af7-40a5-bd4e-d39679d94254 service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:46.057970 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-d01ed9d6-02ea-4dd7-80df-a4f020f400d8 req-5b12b87d-5af7-40a5-bd4e-d39679d94254 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:46.058403 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-d01ed9d6-02ea-4dd7-80df-a4f020f400d8 req-5b12b87d-5af7-40a5-bd4e-d39679d94254 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:46.071679 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-d01ed9d6-02ea-4dd7-80df-a4f020f400d8 req-5b12b87d-5af7-40a5-bd4e-d39679d94254 service nova] Creating event network-changed:29dfcfdc-0475-40e4-a4ec-d26e3026aa4a for instance f7d66e43-86cd-49c9-9bf0-09489b7fd178 on hv-cinder-83538 Aug 31 19:17:46.077217 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-d01ed9d6-02ea-4dd7-80df-a4f020f400d8 req-5b12b87d-5af7-40a5-bd4e-d39679d94254 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099534 Aug 31 19:17:46.077839 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 345/694] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:17:47.618237 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-6ae3082d-6f20-4220-a8f1-2d6bad46b8a1 req-7e4345ce-1d17-45ea-a300-9fa7eb257c5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5537ff84-8f70-4ba6-b219-09ffa1164d9a", "tag": "ac12d0b7-5798-4d48-8cb0-9040f44c18b1"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:17:47.623321 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_api:SELECT=31 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:17:47.630204 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-6ae3082d-6f20-4220-a8f1-2d6bad46b8a1 req-7e4345ce-1d17-45ea-a300-9fa7eb257c5b service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:47.630581 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-6ae3082d-6f20-4220-a8f1-2d6bad46b8a1 req-7e4345ce-1d17-45ea-a300-9fa7eb257c5b service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:47.631052 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-6ae3082d-6f20-4220-a8f1-2d6bad46b8a1 req-7e4345ce-1d17-45ea-a300-9fa7eb257c5b service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:47.646954 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-6ae3082d-6f20-4220-a8f1-2d6bad46b8a1 req-7e4345ce-1d17-45ea-a300-9fa7eb257c5b service nova] Creating event network-changed:ac12d0b7-5798-4d48-8cb0-9040f44c18b1 for instance 5537ff84-8f70-4ba6-b219-09ffa1164d9a on hv-cinder-83538 Aug 31 19:17:47.652764 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-6ae3082d-6f20-4220-a8f1-2d6bad46b8a1 req-7e4345ce-1d17-45ea-a300-9fa7eb257c5b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103008 Aug 31 19:17:47.659009 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 350/695] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:17:47.670122 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-f4d148da-4894-4174-aa57-54bcb4146540 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:47.671341 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-f4d148da-4894-4174-aa57-54bcb4146540 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: 99d78918-36ca-462d-9037-ea8b81fbfc2e] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:17:47.678476 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f4d148da-4894-4174-aa57-54bcb4146540 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:47.678967 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f4d148da-4894-4174-aa57-54bcb4146540 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:47.679410 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f4d148da-4894-4174-aa57-54bcb4146540 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:47.680099 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f4d148da-4894-4174-aa57-54bcb4146540 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:47.680552 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f4d148da-4894-4174-aa57-54bcb4146540 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:47.680977 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f4d148da-4894-4174-aa57-54bcb4146540 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:47.850042 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.objects.instance [None req-f4d148da-4894-4174-aa57-54bcb4146540 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lazy-loading 'services' on Instance uuid 99d78918-36ca-462d-9037-ea8b81fbfc2e {{(pid=120623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:17:47.988903 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-f4d148da-4894-4174-aa57-54bcb4146540 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] 10.222.0.65 "DELETE /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e/os-volume_attachments/f7aecfd8-81db-4c74-870e-d0b57645cefc" status: 202 len: 0 microversion: 2.1 time: 0.323308 Aug 31 19:17:47.990235 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 346/696] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Aug 31 19:17:47 2022] DELETE /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e/os-volume_attachments/f7aecfd8-81db-4c74-870e-d0b57645cefc => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:17:48.802064 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-7f35a763-4920-4a26-a1b5-75a81dd14b0e tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1059620827"}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:17:48.803390 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-7f35a763-4920-4a26-a1b5-75a81dd14b0e tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] [instance: 5537ff84-8f70-4ba6-b219-09ffa1164d9a] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:17:48.811879 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7f35a763-4920-4a26-a1b5-75a81dd14b0e tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:48.812367 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7f35a763-4920-4a26-a1b5-75a81dd14b0e tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:48.812798 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7f35a763-4920-4a26-a1b5-75a81dd14b0e tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:48.814087 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7f35a763-4920-4a26-a1b5-75a81dd14b0e tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:48.814535 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7f35a763-4920-4a26-a1b5-75a81dd14b0e tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:48.814954 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7f35a763-4920-4a26-a1b5-75a81dd14b0e tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:48.951077 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.network.security_group_api [None req-7f35a763-4920-4a26-a1b5-75a81dd14b0e tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Adding security group 292be38d-f81e-48ff-bef3-84dddc1a49db to port ac12d0b7-5798-4d48-8cb0-9040f44c18b1 Aug 31 19:17:49.293367 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-7f35a763-4920-4a26-a1b5-75a81dd14b0e tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] 10.222.0.65 "POST /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a/action" status: 202 len: 0 microversion: 2.1 time: 0.497508 Aug 31 19:17:49.293967 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 351/697] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 31 19:17:48 2022] POST /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a/action => generated 0 bytes in 499 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:17:49.303563 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-c63f872c-a1b4-43cd-af29-5045318f1715 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:49.304257 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-c63f872c-a1b4-43cd-af29-5045318f1715 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] [instance: 5537ff84-8f70-4ba6-b219-09ffa1164d9a] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:17:49.311098 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c63f872c-a1b4-43cd-af29-5045318f1715 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:49.311580 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c63f872c-a1b4-43cd-af29-5045318f1715 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:49.312015 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c63f872c-a1b4-43cd-af29-5045318f1715 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:49.312708 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c63f872c-a1b4-43cd-af29-5045318f1715 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:49.313159 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c63f872c-a1b4-43cd-af29-5045318f1715 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:49.313872 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c63f872c-a1b4-43cd-af29-5045318f1715 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:49.469996 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-c63f872c-a1b4-43cd-af29-5045318f1715 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07fb9a216ac4683852fc6cae7c10b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8ee0bdd09b45599a7c19798660aac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:17:49.478377 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-c63f872c-a1b4-43cd-af29-5045318f1715 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] 10.222.0.65 "GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a" status: 200 len: 1755 microversion: 2.1 time: 0.179216 Aug 31 19:17:49.478942 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 347/698] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:17:49 2022] GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a => generated 1755 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:17:49.669138 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-682efd2d-3ab7-4165-94ae-b86a3ef63fc4 req-700625b5-5ade-490c-828c-ede8cb9a8281 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5537ff84-8f70-4ba6-b219-09ffa1164d9a", "tag": "ac12d0b7-5798-4d48-8cb0-9040f44c18b1"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:17:49.679408 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-682efd2d-3ab7-4165-94ae-b86a3ef63fc4 req-700625b5-5ade-490c-828c-ede8cb9a8281 service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:49.679868 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-682efd2d-3ab7-4165-94ae-b86a3ef63fc4 req-700625b5-5ade-490c-828c-ede8cb9a8281 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:49.680281 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-682efd2d-3ab7-4165-94ae-b86a3ef63fc4 req-700625b5-5ade-490c-828c-ede8cb9a8281 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:49.691531 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-682efd2d-3ab7-4165-94ae-b86a3ef63fc4 req-700625b5-5ade-490c-828c-ede8cb9a8281 service nova] Creating event network-changed:ac12d0b7-5798-4d48-8cb0-9040f44c18b1 for instance 5537ff84-8f70-4ba6-b219-09ffa1164d9a on hv-cinder-83538 Aug 31 19:17:49.696426 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-682efd2d-3ab7-4165-94ae-b86a3ef63fc4 req-700625b5-5ade-490c-828c-ede8cb9a8281 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030939 Aug 31 19:17:49.697005 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 352/699] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:17:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:17:50.191931 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-84a02116-1711-4c4f-bf97-967ce07f12f4 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:50.192547 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-84a02116-1711-4c4f-bf97-967ce07f12f4 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: 99d78918-36ca-462d-9037-ea8b81fbfc2e] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:17:50.198996 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-84a02116-1711-4c4f-bf97-967ce07f12f4 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:50.199488 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-84a02116-1711-4c4f-bf97-967ce07f12f4 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:50.199921 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-84a02116-1711-4c4f-bf97-967ce07f12f4 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:50.200626 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-84a02116-1711-4c4f-bf97-967ce07f12f4 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:50.201075 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-84a02116-1711-4c4f-bf97-967ce07f12f4 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:50.201519 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-84a02116-1711-4c4f-bf97-967ce07f12f4 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:50.229710 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-84a02116-1711-4c4f-bf97-967ce07f12f4 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: 99d78918-36ca-462d-9037-ea8b81fbfc2e] Going to try to terminate instance {{(pid=120623) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 19:17:50.312898 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-84a02116-1711-4c4f-bf97-967ce07f12f4 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] 10.222.0.65 "DELETE /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e" status: 204 len: 0 microversion: 2.1 time: 0.124795 Aug 31 19:17:50.314752 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 348/700] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 31 19:17:50 2022] DELETE /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 19:17:50.324652 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-82738bdc-b3d4-4ab4-877d-6a00bba617b9 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:50.325465 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-82738bdc-b3d4-4ab4-877d-6a00bba617b9 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: 99d78918-36ca-462d-9037-ea8b81fbfc2e] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:17:50.332900 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-82738bdc-b3d4-4ab4-877d-6a00bba617b9 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:50.333419 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-82738bdc-b3d4-4ab4-877d-6a00bba617b9 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:50.333844 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-82738bdc-b3d4-4ab4-877d-6a00bba617b9 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:50.334561 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-82738bdc-b3d4-4ab4-877d-6a00bba617b9 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:50.335219 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-82738bdc-b3d4-4ab4-877d-6a00bba617b9 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:50.335637 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-82738bdc-b3d4-4ab4-877d-6a00bba617b9 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:50.473173 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-82738bdc-b3d4-4ab4-877d-6a00bba617b9 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b8da543ad543bb95881450e4f9b585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5f61674804f93bd2127fc76919bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:17:50.480956 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-82738bdc-b3d4-4ab4-877d-6a00bba617b9 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] 10.222.0.65 "GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e" status: 200 len: 1512 microversion: 2.1 time: 0.161506 Aug 31 19:17:50.481560 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 353/701] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:17:50 2022] GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e => generated 1512 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:17:51.502419 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-faeda81f-d407-46ff-904a-48c38b27c0b3 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:51.503123 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-faeda81f-d407-46ff-904a-48c38b27c0b3 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: 99d78918-36ca-462d-9037-ea8b81fbfc2e] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:17:51.509464 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-faeda81f-d407-46ff-904a-48c38b27c0b3 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:51.509950 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-faeda81f-d407-46ff-904a-48c38b27c0b3 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:51.510385 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-faeda81f-d407-46ff-904a-48c38b27c0b3 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:51.511068 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-faeda81f-d407-46ff-904a-48c38b27c0b3 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:51.511521 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-faeda81f-d407-46ff-904a-48c38b27c0b3 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:51.511943 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-faeda81f-d407-46ff-904a-48c38b27c0b3 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:51.640478 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-faeda81f-d407-46ff-904a-48c38b27c0b3 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b8da543ad543bb95881450e4f9b585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5f61674804f93bd2127fc76919bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:17:51.649078 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-faeda81f-d407-46ff-904a-48c38b27c0b3 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] 10.222.0.65 "GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e" status: 200 len: 1512 microversion: 2.1 time: 0.150818 Aug 31 19:17:51.649685 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 349/702] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:17:51 2022] GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:17:52.670897 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-ff6f7bbd-d325-423a-a1fd-64a8d1a7b361 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:52.671507 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-ff6f7bbd-d325-423a-a1fd-64a8d1a7b361 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: 99d78918-36ca-462d-9037-ea8b81fbfc2e] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:17:52.679176 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ff6f7bbd-d325-423a-a1fd-64a8d1a7b361 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:52.679807 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ff6f7bbd-d325-423a-a1fd-64a8d1a7b361 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:52.680242 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ff6f7bbd-d325-423a-a1fd-64a8d1a7b361 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:52.680993 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ff6f7bbd-d325-423a-a1fd-64a8d1a7b361 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:52.681478 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ff6f7bbd-d325-423a-a1fd-64a8d1a7b361 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:52.681902 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ff6f7bbd-d325-423a-a1fd-64a8d1a7b361 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:52.814398 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-ff6f7bbd-d325-423a-a1fd-64a8d1a7b361 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b8da543ad543bb95881450e4f9b585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5f61674804f93bd2127fc76919bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:17:52.822455 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-ff6f7bbd-d325-423a-a1fd-64a8d1a7b361 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] 10.222.0.65 "GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e" status: 200 len: 1512 microversion: 2.1 time: 0.155463 Aug 31 19:17:52.823028 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 354/703] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:17:52 2022] GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:17:53.107655 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-7767c82f-e84f-4705-b36a-cb071519b656 req-38cb45b5-b4cd-4442-b288-a82a858eaa44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99d78918-36ca-462d-9037-ea8b81fbfc2e", "name": "network-vif-deleted", "tag": "26de47b8-1d7b-4d14-aacf-b275eb478d29"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:17:53.118582 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-7767c82f-e84f-4705-b36a-cb071519b656 req-38cb45b5-b4cd-4442-b288-a82a858eaa44 service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:53.119054 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-7767c82f-e84f-4705-b36a-cb071519b656 req-38cb45b5-b4cd-4442-b288-a82a858eaa44 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:53.119478 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-7767c82f-e84f-4705-b36a-cb071519b656 req-38cb45b5-b4cd-4442-b288-a82a858eaa44 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:53.130932 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-7767c82f-e84f-4705-b36a-cb071519b656 req-38cb45b5-b4cd-4442-b288-a82a858eaa44 service nova] Creating event network-vif-deleted:26de47b8-1d7b-4d14-aacf-b275eb478d29 for instance 99d78918-36ca-462d-9037-ea8b81fbfc2e on hv-cinder-83538 Aug 31 19:17:53.135777 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-7767c82f-e84f-4705-b36a-cb071519b656 req-38cb45b5-b4cd-4442-b288-a82a858eaa44 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031827 Aug 31 19:17:53.136622 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 350/704] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:17:53.842654 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-b4eb720f-51b9-4bb7-a184-2bb1efd2bc6c tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:53.843245 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-b4eb720f-51b9-4bb7-a184-2bb1efd2bc6c tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: 99d78918-36ca-462d-9037-ea8b81fbfc2e] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:17:53.849670 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b4eb720f-51b9-4bb7-a184-2bb1efd2bc6c tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:53.850142 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b4eb720f-51b9-4bb7-a184-2bb1efd2bc6c tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:53.850567 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b4eb720f-51b9-4bb7-a184-2bb1efd2bc6c tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:53.851249 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b4eb720f-51b9-4bb7-a184-2bb1efd2bc6c tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:53.851683 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b4eb720f-51b9-4bb7-a184-2bb1efd2bc6c tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:53.852340 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b4eb720f-51b9-4bb7-a184-2bb1efd2bc6c tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:53.884152 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b4eb720f-51b9-4bb7-a184-2bb1efd2bc6c tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:53.884628 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b4eb720f-51b9-4bb7-a184-2bb1efd2bc6c tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:53.885052 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b4eb720f-51b9-4bb7-a184-2bb1efd2bc6c tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:53.885531 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.objects.instance [None req-b4eb720f-51b9-4bb7-a184-2bb1efd2bc6c tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lazy-loading 'fault' on Instance uuid 99d78918-36ca-462d-9037-ea8b81fbfc2e {{(pid=120624) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:17:53.929466 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-b4eb720f-51b9-4bb7-a184-2bb1efd2bc6c tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b8da543ad543bb95881450e4f9b585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5f61674804f93bd2127fc76919bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:17:53.936330 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-b4eb720f-51b9-4bb7-a184-2bb1efd2bc6c tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] 10.222.0.65 "GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e" status: 200 len: 1308 microversion: 2.1 time: 0.097492 Aug 31 19:17:53.936907 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 355/705] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:17:53 2022] GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e => generated 1308 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:17:54.959489 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-520b8047-c904-42dc-aa42-dbe967573937 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:54.960125 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-520b8047-c904-42dc-aa42-dbe967573937 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: 99d78918-36ca-462d-9037-ea8b81fbfc2e] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:17:54.966256 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-520b8047-c904-42dc-aa42-dbe967573937 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:54.966813 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-520b8047-c904-42dc-aa42-dbe967573937 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:54.967243 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-520b8047-c904-42dc-aa42-dbe967573937 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:54.967927 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-520b8047-c904-42dc-aa42-dbe967573937 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:54.968423 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-520b8047-c904-42dc-aa42-dbe967573937 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:54.968888 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-520b8047-c904-42dc-aa42-dbe967573937 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:54.983856 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.wsgi [None req-520b8047-c904-42dc-aa42-dbe967573937 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] HTTP exception thrown: Instance 99d78918-36ca-462d-9037-ea8b81fbfc2e could not be found. Aug 31 19:17:54.985476 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-520b8047-c904-42dc-aa42-dbe967573937 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Request method failure captured: Aug 31 19:17:54.985476 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: request: GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e HTTP/1.1 Aug 31 19:17:54.985476 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Accept: application/json Aug 31 19:17:54.985476 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Accept-Encoding: identity Aug 31 19:17:54.985476 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Connection: close Aug 31 19:17:54.985476 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Content-Length: 0 Aug 31 19:17:54.985476 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Content-Type: application/json Aug 31 19:17:54.985476 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Host: 10.222.0.65 Aug 31 19:17:54.985476 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Openstack-System-Scope: None Aug 31 19:17:54.985476 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: User-Agent: python-urllib3/1.26.12 Aug 31 19:17:54.985476 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Auth-Token: gAAAAABjD7NdvbGltdLmCtEreaI2KduoXFqKrwgEn538cbhmjXVLJ86gUiU1gz8kmuYZNm6sQHz5W4NAPUK4mzLMaxEwaXl1e6YcJTL-w8fQ9WLeFUSgu_k4RuHnFTelz5yojuz2HV9CWaxAxgBGa46Mu0_bwPu-YT1CgFxONQ5seUiYmkGItUU Aug 31 19:17:54.985476 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Domain-Id: None Aug 31 19:17:54.985476 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Domain-Name: None Aug 31 19:17:54.985476 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Identity-Status: Confirmed Aug 31 19:17:54.985476 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Is-Admin-Project: True Aug 31 19:17:54.985476 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Id: default Aug 31 19:17:54.985476 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Name: Default Aug 31 19:17:54.985476 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Id: 08d5f61674804f93bd2127fc76919bd3 Aug 31 19:17:54.985476 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Name: tempest-VolumesSnapshotTestJSON-482199141 Aug 31 19:17:54.985476 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Role: member,reader Aug 31 19:17:54.985476 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Roles: member,reader Aug 31 19:17:54.986945 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/08d5f61674804f93bd2127fc76919bd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/08d5f61674804f93bd2127fc76919bd3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_08d5f61674804f93bd2127fc76919bd3", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/08d5f61674804f93bd2127fc76919bd3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:17:54.986945 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant: tempest-VolumesSnapshotTestJSON-482199141 Aug 31 19:17:54.986945 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant-Id: 08d5f61674804f93bd2127fc76919bd3 Aug 31 19:17:54.986945 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-482199141 Aug 31 19:17:54.986945 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User: tempest-VolumesSnapshotTestJSON-482199141-project Aug 31 19:17:54.986945 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Id: default Aug 31 19:17:54.986945 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Name: Default Aug 31 19:17:54.986945 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Id: b1b8da543ad543bb95881450e4f9b585 Aug 31 19:17:54.986945 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Name: tempest-VolumesSnapshotTestJSON-482199141-project Aug 31 19:17:54.986945 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: method: > Aug 31 19:17:54.986945 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: exception: Instance 99d78918-36ca-462d-9037-ea8b81fbfc2e could not be found. Aug 31 19:17:54.986945 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: action_args: {'id': '99d78918-36ca-462d-9037-ea8b81fbfc2e'} Aug 31 19:17:54.987730 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:17:54.987730 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:17:54.987730 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:17:54.987730 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:17:54.987730 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:17:54.987730 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:17:54.987730 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:17:54.987730 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:17:54.987730 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:17:54.987730 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:17:54.987730 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99d78918-36ca-462d-9037-ea8b81fbfc2e could not be found. Aug 31 19:17:54.987730 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:17:54.987730 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:17:54.987730 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:17:54.987730 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:17:54.987730 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:17:54.987730 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:17:54.987730 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:17:54.987730 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:17:54.987730 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:17:54.989322 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:17:54.989322 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:17:54.989322 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:17:54.989322 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:17:54.989322 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:17:54.989322 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:17:54.989322 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:17:54.989322 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99d78918-36ca-462d-9037-ea8b81fbfc2e could not be found. Aug 31 19:17:54.989322 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:17:54.989322 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:17:54.989322 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:17:54.989322 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:17:54.989322 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:17:54.989322 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:17:54.989322 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:17:54.989322 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:17:54.989322 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99d78918-36ca-462d-9037-ea8b81fbfc2e could not be found. Aug 31 19:17:54.989322 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:17:54.991100 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-520b8047-c904-42dc-aa42-dbe967573937 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Returning 404 to user: Instance 99d78918-36ca-462d-9037-ea8b81fbfc2e could not be found. {{(pid=120623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:17:54.991100 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-520b8047-c904-42dc-aa42-dbe967573937 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] 10.222.0.65 "GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e" status: 404 len: 111 microversion: 2.1 time: 0.032846 Aug 31 19:17:54.991100 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 351/706] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:17:54 2022] GET /compute/v2.1/servers/99d78918-36ca-462d-9037-ea8b81fbfc2e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:18:06.926266 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-375e22e9-547c-4e0b-b890-d019139892de tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1565073423", "imageRef": "f4f2ae76-bacc-4449-881b-f697e1eeec66", "flavorRef": "452", "networks": [{"uuid": "0d30bf9a-bd0d-4b7f-ab18-0782e567548f"}]}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:18:06.935739 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_api:SELECT=13 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:06.936373 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=39 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:06.981518 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.network.neutron [None req-375e22e9-547c-4e0b-b890-d019139892de tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] validate_networks() for [('0d30bf9a-bd0d-4b7f-ab18-0782e567548f', None, None, None, None, None)] {{(pid=120624) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:18:07.370518 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-375e22e9-547c-4e0b-b890-d019139892de tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Flavor limits 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:18:07.370950 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-375e22e9-547c-4e0b-b890-d019139892de tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Image limits 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:18:07.371421 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-375e22e9-547c-4e0b-b890-d019139892de tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Flavor pref 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:18:07.371828 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-375e22e9-547c-4e0b-b890-d019139892de tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Image pref 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:18:07.372238 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-375e22e9-547c-4e0b-b890-d019139892de tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:18:07.380929 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-375e22e9-547c-4e0b-b890-d019139892de tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:07.381456 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-375e22e9-547c-4e0b-b890-d019139892de tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:07.381889 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-375e22e9-547c-4e0b-b890-d019139892de tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:07.382612 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-375e22e9-547c-4e0b-b890-d019139892de tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:07.383070 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-375e22e9-547c-4e0b-b890-d019139892de tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:07.383492 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-375e22e9-547c-4e0b-b890-d019139892de tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:07.400449 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-375e22e9-547c-4e0b-b890-d019139892de tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Getting quotas for project 08d5f61674804f93bd2127fc76919bd3. Resources: {'instances', 'cores', 'ram'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:18:07.404387 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-375e22e9-547c-4e0b-b890-d019139892de tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Getting quotas for user b1b8da543ad543bb95881450e4f9b585 and project 08d5f61674804f93bd2127fc76919bd3. Resources: {'instances', 'cores', 'ram'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:18:07.415751 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-375e22e9-547c-4e0b-b890-d019139892de tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Going to run 1 instances... {{(pid=120624) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:18:07.418112 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-375e22e9-547c-4e0b-b890-d019139892de tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: b685acd5-7b0d-481c-8564-d7908f33abfa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f4f2ae76-bacc-4449-881b-f697e1eeec66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120624) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:18:07.463609 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-375e22e9-547c-4e0b-b890-d019139892de tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.541191 Aug 31 19:18:07.464492 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 356/707] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 31 19:18:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 543 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 19:18:07.475707 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d2356b4a-8d7a-4d36-b210-688d34e64592 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:07.476465 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d2356b4a-8d7a-4d36-b210-688d34e64592 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: b685acd5-7b0d-481c-8564-d7908f33abfa] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:07.482640 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:07.483382 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:07.539873 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-d2356b4a-8d7a-4d36-b210-688d34e64592 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b8da543ad543bb95881450e4f9b585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5f61674804f93bd2127fc76919bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:07.547227 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-d2356b4a-8d7a-4d36-b210-688d34e64592 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] 10.222.0.65 "GET /compute/v2.1/servers/b685acd5-7b0d-481c-8564-d7908f33abfa" status: 200 len: 1219 microversion: 2.1 time: 0.075925 Aug 31 19:18:07.548184 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 352/708] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:07 2022] GET /compute/v2.1/servers/b685acd5-7b0d-481c-8564-d7908f33abfa => generated 1219 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:08.568200 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-446ba1de-6865-4da1-83b7-e9c322f077ac tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:08.568840 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-446ba1de-6865-4da1-83b7-e9c322f077ac tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: b685acd5-7b0d-481c-8564-d7908f33abfa] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:08.580523 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-446ba1de-6865-4da1-83b7-e9c322f077ac tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:08.581008 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-446ba1de-6865-4da1-83b7-e9c322f077ac tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:08.581466 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-446ba1de-6865-4da1-83b7-e9c322f077ac tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:08.582163 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-446ba1de-6865-4da1-83b7-e9c322f077ac tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:08.582618 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-446ba1de-6865-4da1-83b7-e9c322f077ac tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:08.583168 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-446ba1de-6865-4da1-83b7-e9c322f077ac tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:08.654130 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-446ba1de-6865-4da1-83b7-e9c322f077ac tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b8da543ad543bb95881450e4f9b585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5f61674804f93bd2127fc76919bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:08.662485 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-446ba1de-6865-4da1-83b7-e9c322f077ac tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] 10.222.0.65 "GET /compute/v2.1/servers/b685acd5-7b0d-481c-8564-d7908f33abfa" status: 200 len: 1271 microversion: 2.1 time: 0.098075 Aug 31 19:18:08.663040 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 357/709] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:08 2022] GET /compute/v2.1/servers/b685acd5-7b0d-481c-8564-d7908f33abfa => generated 1271 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:09.684091 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e41f4c75-e986-451e-a352-2f5f220036a9 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:09.684733 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-e41f4c75-e986-451e-a352-2f5f220036a9 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: b685acd5-7b0d-481c-8564-d7908f33abfa] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:09.692217 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e41f4c75-e986-451e-a352-2f5f220036a9 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:09.692834 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e41f4c75-e986-451e-a352-2f5f220036a9 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:09.693341 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e41f4c75-e986-451e-a352-2f5f220036a9 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:09.694040 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e41f4c75-e986-451e-a352-2f5f220036a9 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:09.694514 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e41f4c75-e986-451e-a352-2f5f220036a9 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:09.694922 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e41f4c75-e986-451e-a352-2f5f220036a9 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:09.944322 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e41f4c75-e986-451e-a352-2f5f220036a9 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b8da543ad543bb95881450e4f9b585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5f61674804f93bd2127fc76919bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:09.951953 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-e41f4c75-e986-451e-a352-2f5f220036a9 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] 10.222.0.65 "GET /compute/v2.1/servers/b685acd5-7b0d-481c-8564-d7908f33abfa" status: 200 len: 1319 microversion: 2.1 time: 0.271988 Aug 31 19:18:09.952715 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 353/710] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:09 2022] GET /compute/v2.1/servers/b685acd5-7b0d-481c-8564-d7908f33abfa => generated 1319 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:10.239759 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-2823cbd2-251e-40a0-b711-8c528a7f3518 req-f0ae3381-9556-423f-93f8-8c70c9cf406c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b685acd5-7b0d-481c-8564-d7908f33abfa", "tag": "ee49acee-f0d6-48ab-9607-47759bd3a358"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:18:10.251377 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-2823cbd2-251e-40a0-b711-8c528a7f3518 req-f0ae3381-9556-423f-93f8-8c70c9cf406c service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:10.251923 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-2823cbd2-251e-40a0-b711-8c528a7f3518 req-f0ae3381-9556-423f-93f8-8c70c9cf406c service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:10.252349 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-2823cbd2-251e-40a0-b711-8c528a7f3518 req-f0ae3381-9556-423f-93f8-8c70c9cf406c service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:10.264690 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-2823cbd2-251e-40a0-b711-8c528a7f3518 req-f0ae3381-9556-423f-93f8-8c70c9cf406c service nova] Creating event network-changed:ee49acee-f0d6-48ab-9607-47759bd3a358 for instance b685acd5-7b0d-481c-8564-d7908f33abfa on hv-cinder-83538 Aug 31 19:18:10.269379 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-2823cbd2-251e-40a0-b711-8c528a7f3518 req-f0ae3381-9556-423f-93f8-8c70c9cf406c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033464 Aug 31 19:18:10.269983 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 358/711] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:18:10.972147 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-7eb4023e-93b3-424c-85d7-aed51639c0f4 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:10.972706 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-7eb4023e-93b3-424c-85d7-aed51639c0f4 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: b685acd5-7b0d-481c-8564-d7908f33abfa] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:10.979417 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7eb4023e-93b3-424c-85d7-aed51639c0f4 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:10.979897 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7eb4023e-93b3-424c-85d7-aed51639c0f4 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:10.980331 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7eb4023e-93b3-424c-85d7-aed51639c0f4 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:10.981014 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7eb4023e-93b3-424c-85d7-aed51639c0f4 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:10.981495 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7eb4023e-93b3-424c-85d7-aed51639c0f4 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:10.981938 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7eb4023e-93b3-424c-85d7-aed51639c0f4 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:11.110061 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-7eb4023e-93b3-424c-85d7-aed51639c0f4 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b8da543ad543bb95881450e4f9b585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5f61674804f93bd2127fc76919bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:11.118082 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-7eb4023e-93b3-424c-85d7-aed51639c0f4 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] 10.222.0.65 "GET /compute/v2.1/servers/b685acd5-7b0d-481c-8564-d7908f33abfa" status: 200 len: 1319 microversion: 2.1 time: 0.149907 Aug 31 19:18:11.118637 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 354/712] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:10 2022] GET /compute/v2.1/servers/b685acd5-7b0d-481c-8564-d7908f33abfa => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:12.139933 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-83c6640c-c260-4bda-8b54-7887a854cdd4 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:12.140545 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-83c6640c-c260-4bda-8b54-7887a854cdd4 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: b685acd5-7b0d-481c-8564-d7908f33abfa] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:12.146748 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-83c6640c-c260-4bda-8b54-7887a854cdd4 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:12.147837 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-83c6640c-c260-4bda-8b54-7887a854cdd4 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:12.148267 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-83c6640c-c260-4bda-8b54-7887a854cdd4 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:12.148951 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-83c6640c-c260-4bda-8b54-7887a854cdd4 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:12.149424 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-83c6640c-c260-4bda-8b54-7887a854cdd4 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:12.149844 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-83c6640c-c260-4bda-8b54-7887a854cdd4 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:12.284127 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-83c6640c-c260-4bda-8b54-7887a854cdd4 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b8da543ad543bb95881450e4f9b585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5f61674804f93bd2127fc76919bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:12.291740 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-83c6640c-c260-4bda-8b54-7887a854cdd4 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] 10.222.0.65 "GET /compute/v2.1/servers/b685acd5-7b0d-481c-8564-d7908f33abfa" status: 200 len: 1319 microversion: 2.1 time: 0.156575 Aug 31 19:18:12.292299 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 359/713] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:12 2022] GET /compute/v2.1/servers/b685acd5-7b0d-481c-8564-d7908f33abfa => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:13.312537 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-8aeb0102-5e77-4c67-81c0-a87ac4d4ca14 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:13.313137 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-8aeb0102-5e77-4c67-81c0-a87ac4d4ca14 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: b685acd5-7b0d-481c-8564-d7908f33abfa] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:13.320151 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8aeb0102-5e77-4c67-81c0-a87ac4d4ca14 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:13.320622 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8aeb0102-5e77-4c67-81c0-a87ac4d4ca14 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:13.321046 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8aeb0102-5e77-4c67-81c0-a87ac4d4ca14 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:13.321756 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8aeb0102-5e77-4c67-81c0-a87ac4d4ca14 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:13.322198 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8aeb0102-5e77-4c67-81c0-a87ac4d4ca14 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:13.322612 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8aeb0102-5e77-4c67-81c0-a87ac4d4ca14 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:13.451888 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-8aeb0102-5e77-4c67-81c0-a87ac4d4ca14 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b8da543ad543bb95881450e4f9b585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5f61674804f93bd2127fc76919bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:13.459380 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-8aeb0102-5e77-4c67-81c0-a87ac4d4ca14 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] 10.222.0.65 "GET /compute/v2.1/servers/b685acd5-7b0d-481c-8564-d7908f33abfa" status: 200 len: 1319 microversion: 2.1 time: 0.150674 Aug 31 19:18:13.459921 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 355/714] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:13 2022] GET /compute/v2.1/servers/b685acd5-7b0d-481c-8564-d7908f33abfa => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:14.480931 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-4a1f33db-1e1e-4e9f-88d2-2ed75a285844 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:14.481375 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-4a1f33db-1e1e-4e9f-88d2-2ed75a285844 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: b685acd5-7b0d-481c-8564-d7908f33abfa] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:14.487832 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4a1f33db-1e1e-4e9f-88d2-2ed75a285844 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:14.488306 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4a1f33db-1e1e-4e9f-88d2-2ed75a285844 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:14.488730 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4a1f33db-1e1e-4e9f-88d2-2ed75a285844 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:14.489462 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4a1f33db-1e1e-4e9f-88d2-2ed75a285844 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:14.489906 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4a1f33db-1e1e-4e9f-88d2-2ed75a285844 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:14.490319 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4a1f33db-1e1e-4e9f-88d2-2ed75a285844 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:14.618669 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-4a1f33db-1e1e-4e9f-88d2-2ed75a285844 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b8da543ad543bb95881450e4f9b585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5f61674804f93bd2127fc76919bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:14.626441 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-4a1f33db-1e1e-4e9f-88d2-2ed75a285844 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] 10.222.0.65 "GET /compute/v2.1/servers/b685acd5-7b0d-481c-8564-d7908f33abfa" status: 200 len: 1319 microversion: 2.1 time: 0.150476 Aug 31 19:18:14.627000 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 360/715] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:14 2022] GET /compute/v2.1/servers/b685acd5-7b0d-481c-8564-d7908f33abfa => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:15.647475 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-5b19018b-b783-445b-8daa-38f33fab41c7 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:15.648025 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-5b19018b-b783-445b-8daa-38f33fab41c7 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: b685acd5-7b0d-481c-8564-d7908f33abfa] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:15.654031 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5b19018b-b783-445b-8daa-38f33fab41c7 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:15.654516 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5b19018b-b783-445b-8daa-38f33fab41c7 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:15.654949 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5b19018b-b783-445b-8daa-38f33fab41c7 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:15.655636 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5b19018b-b783-445b-8daa-38f33fab41c7 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:15.656088 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5b19018b-b783-445b-8daa-38f33fab41c7 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:15.656511 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5b19018b-b783-445b-8daa-38f33fab41c7 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:15.784843 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-5b19018b-b783-445b-8daa-38f33fab41c7 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b8da543ad543bb95881450e4f9b585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5f61674804f93bd2127fc76919bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:15.793026 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-5b19018b-b783-445b-8daa-38f33fab41c7 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] 10.222.0.65 "GET /compute/v2.1/servers/b685acd5-7b0d-481c-8564-d7908f33abfa" status: 200 len: 1319 microversion: 2.1 time: 0.149990 Aug 31 19:18:15.793637 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 356/716] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:15 2022] GET /compute/v2.1/servers/b685acd5-7b0d-481c-8564-d7908f33abfa => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:16.814059 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-80f32820-590b-4ab7-9385-9505665d0593 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:16.814670 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-80f32820-590b-4ab7-9385-9505665d0593 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: b685acd5-7b0d-481c-8564-d7908f33abfa] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:16.821351 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-80f32820-590b-4ab7-9385-9505665d0593 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:16.821821 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-80f32820-590b-4ab7-9385-9505665d0593 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:16.822247 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-80f32820-590b-4ab7-9385-9505665d0593 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:16.822937 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-80f32820-590b-4ab7-9385-9505665d0593 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:16.823387 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-80f32820-590b-4ab7-9385-9505665d0593 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:16.823806 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-80f32820-590b-4ab7-9385-9505665d0593 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:16.952384 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-80f32820-590b-4ab7-9385-9505665d0593 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b8da543ad543bb95881450e4f9b585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5f61674804f93bd2127fc76919bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:16.960077 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-80f32820-590b-4ab7-9385-9505665d0593 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] 10.222.0.65 "GET /compute/v2.1/servers/b685acd5-7b0d-481c-8564-d7908f33abfa" status: 200 len: 1319 microversion: 2.1 time: 0.149847 Aug 31 19:18:16.960642 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 361/717] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:16 2022] GET /compute/v2.1/servers/b685acd5-7b0d-481c-8564-d7908f33abfa => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:17.955331 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell0:SELECT=2 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:17.981331 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-02457aae-f931-431d-889a-a7b62e367e35 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:17.981783 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-02457aae-f931-431d-889a-a7b62e367e35 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: b685acd5-7b0d-481c-8564-d7908f33abfa] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:17.983699 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell0:SELECT=2 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:17.984841 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell0:SELECT=6 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:17.990785 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-02457aae-f931-431d-889a-a7b62e367e35 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:17.991302 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-02457aae-f931-431d-889a-a7b62e367e35 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:17.991728 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-02457aae-f931-431d-889a-a7b62e367e35 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:17.992988 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-02457aae-f931-431d-889a-a7b62e367e35 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:17.993485 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-02457aae-f931-431d-889a-a7b62e367e35 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:17.993908 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-02457aae-f931-431d-889a-a7b62e367e35 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:18.018118 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-122e951e-9d6b-4672-9951-e0080083d9fc req-c634e9c0-ec5f-4df1-8546-f6013cf47c8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b685acd5-7b0d-481c-8564-d7908f33abfa", "name": "network-vif-plugged", "status": "completed", "tag": "ee49acee-f0d6-48ab-9607-47759bd3a358"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:18:18.029031 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-122e951e-9d6b-4672-9951-e0080083d9fc req-c634e9c0-ec5f-4df1-8546-f6013cf47c8e service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:18.029541 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-122e951e-9d6b-4672-9951-e0080083d9fc req-c634e9c0-ec5f-4df1-8546-f6013cf47c8e service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:18.029966 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-122e951e-9d6b-4672-9951-e0080083d9fc req-c634e9c0-ec5f-4df1-8546-f6013cf47c8e service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:18.041893 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-122e951e-9d6b-4672-9951-e0080083d9fc req-c634e9c0-ec5f-4df1-8546-f6013cf47c8e service nova] Creating event network-vif-plugged:ee49acee-f0d6-48ab-9607-47759bd3a358 for instance b685acd5-7b0d-481c-8564-d7908f33abfa on hv-cinder-83538 Aug 31 19:18:18.046884 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-122e951e-9d6b-4672-9951-e0080083d9fc req-c634e9c0-ec5f-4df1-8546-f6013cf47c8e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096335 Aug 31 19:18:18.047408 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 357/718] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:18:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:18:18.138354 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-02457aae-f931-431d-889a-a7b62e367e35 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b8da543ad543bb95881450e4f9b585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5f61674804f93bd2127fc76919bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:18.146040 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-02457aae-f931-431d-889a-a7b62e367e35 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] 10.222.0.65 "GET /compute/v2.1/servers/b685acd5-7b0d-481c-8564-d7908f33abfa" status: 200 len: 1319 microversion: 2.1 time: 0.168748 Aug 31 19:18:18.146608 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 362/719] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:17 2022] GET /compute/v2.1/servers/b685acd5-7b0d-481c-8564-d7908f33abfa => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:18:19.168521 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-2eb30783-3b4e-4eda-b82b-0454564d5c9c tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:19.169240 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-2eb30783-3b4e-4eda-b82b-0454564d5c9c tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: b685acd5-7b0d-481c-8564-d7908f33abfa] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:19.175407 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2eb30783-3b4e-4eda-b82b-0454564d5c9c tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:19.175883 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2eb30783-3b4e-4eda-b82b-0454564d5c9c tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:19.176314 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2eb30783-3b4e-4eda-b82b-0454564d5c9c tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:19.177062 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2eb30783-3b4e-4eda-b82b-0454564d5c9c tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:19.177549 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2eb30783-3b4e-4eda-b82b-0454564d5c9c tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:19.177969 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2eb30783-3b4e-4eda-b82b-0454564d5c9c tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:19.308319 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-2eb30783-3b4e-4eda-b82b-0454564d5c9c tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b8da543ad543bb95881450e4f9b585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5f61674804f93bd2127fc76919bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:19.316045 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-2eb30783-3b4e-4eda-b82b-0454564d5c9c tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] 10.222.0.65 "GET /compute/v2.1/servers/b685acd5-7b0d-481c-8564-d7908f33abfa" status: 200 len: 1319 microversion: 2.1 time: 0.152669 Aug 31 19:18:19.316597 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 358/720] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:19 2022] GET /compute/v2.1/servers/b685acd5-7b0d-481c-8564-d7908f33abfa => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:20.336781 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-5dbe9246-83a4-4205-8416-f15142302e57 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:20.337408 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-5dbe9246-83a4-4205-8416-f15142302e57 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: b685acd5-7b0d-481c-8564-d7908f33abfa] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:20.344115 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5dbe9246-83a4-4205-8416-f15142302e57 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:20.344602 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5dbe9246-83a4-4205-8416-f15142302e57 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:20.345033 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5dbe9246-83a4-4205-8416-f15142302e57 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:20.345758 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5dbe9246-83a4-4205-8416-f15142302e57 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:20.346210 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5dbe9246-83a4-4205-8416-f15142302e57 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:20.346628 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5dbe9246-83a4-4205-8416-f15142302e57 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:20.477769 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-5dbe9246-83a4-4205-8416-f15142302e57 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b8da543ad543bb95881450e4f9b585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5f61674804f93bd2127fc76919bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:20.485307 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-5dbe9246-83a4-4205-8416-f15142302e57 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] 10.222.0.65 "GET /compute/v2.1/servers/b685acd5-7b0d-481c-8564-d7908f33abfa" status: 200 len: 1319 microversion: 2.1 time: 0.152372 Aug 31 19:18:20.485875 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 363/721] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:20 2022] GET /compute/v2.1/servers/b685acd5-7b0d-481c-8564-d7908f33abfa => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:21.506369 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-c7d43870-7f75-40a6-a189-c409cac25af9 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:21.507063 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-c7d43870-7f75-40a6-a189-c409cac25af9 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: b685acd5-7b0d-481c-8564-d7908f33abfa] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:21.513645 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c7d43870-7f75-40a6-a189-c409cac25af9 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:21.514205 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c7d43870-7f75-40a6-a189-c409cac25af9 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:21.514638 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c7d43870-7f75-40a6-a189-c409cac25af9 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:21.515324 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c7d43870-7f75-40a6-a189-c409cac25af9 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:21.515782 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c7d43870-7f75-40a6-a189-c409cac25af9 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:21.516200 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c7d43870-7f75-40a6-a189-c409cac25af9 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:21.725140 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-c7d43870-7f75-40a6-a189-c409cac25af9 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b8da543ad543bb95881450e4f9b585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5f61674804f93bd2127fc76919bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:21.733638 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-c7d43870-7f75-40a6-a189-c409cac25af9 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] 10.222.0.65 "GET /compute/v2.1/servers/b685acd5-7b0d-481c-8564-d7908f33abfa" status: 200 len: 1508 microversion: 2.1 time: 0.231147 Aug 31 19:18:21.734203 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 359/722] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:21 2022] GET /compute/v2.1/servers/b685acd5-7b0d-481c-8564-d7908f33abfa => generated 1508 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:21.753552 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-2bcdf3a0-da1a-4e74-8f38-c5d66518131b tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1d5aa12-9585-45e0-a3da-eff9d3007a15", "device": "/dev/sdb"}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:18:21.756413 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-2bcdf3a0-da1a-4e74-8f38-c5d66518131b tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: b685acd5-7b0d-481c-8564-d7908f33abfa] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:21.762749 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2bcdf3a0-da1a-4e74-8f38-c5d66518131b tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:21.763217 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2bcdf3a0-da1a-4e74-8f38-c5d66518131b tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:21.763636 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2bcdf3a0-da1a-4e74-8f38-c5d66518131b tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:21.764320 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2bcdf3a0-da1a-4e74-8f38-c5d66518131b tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:21.764755 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2bcdf3a0-da1a-4e74-8f38-c5d66518131b tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:21.765161 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2bcdf3a0-da1a-4e74-8f38-c5d66518131b tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:22.026847 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-2bcdf3a0-da1a-4e74-8f38-c5d66518131b tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] 10.222.0.65 "POST /compute/v2.1/servers/b685acd5-7b0d-481c-8564-d7908f33abfa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277060 Aug 31 19:18:22.027466 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 364/723] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 31 19:18:21 2022] POST /compute/v2.1/servers/b685acd5-7b0d-481c-8564-d7908f33abfa/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:18:45.458501 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-547ece22-eb91-4a02-ad09-f8742ffece55 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:45.459010 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-547ece22-eb91-4a02-ad09-f8742ffece55 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: b685acd5-7b0d-481c-8564-d7908f33abfa] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:45.461511 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=18 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:45.462165 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=38 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:45.468218 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-547ece22-eb91-4a02-ad09-f8742ffece55 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:45.468702 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-547ece22-eb91-4a02-ad09-f8742ffece55 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:45.469134 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-547ece22-eb91-4a02-ad09-f8742ffece55 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:45.469852 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-547ece22-eb91-4a02-ad09-f8742ffece55 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:45.470305 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-547ece22-eb91-4a02-ad09-f8742ffece55 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:45.470728 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-547ece22-eb91-4a02-ad09-f8742ffece55 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:45.550479 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.objects.instance [None req-547ece22-eb91-4a02-ad09-f8742ffece55 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lazy-loading 'services' on Instance uuid b685acd5-7b0d-481c-8564-d7908f33abfa {{(pid=120623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:18:45.621048 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-547ece22-eb91-4a02-ad09-f8742ffece55 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] 10.222.0.65 "DELETE /compute/v2.1/servers/b685acd5-7b0d-481c-8564-d7908f33abfa/os-volume_attachments/d1d5aa12-9585-45e0-a3da-eff9d3007a15" status: 202 len: 0 microversion: 2.1 time: 0.166309 Aug 31 19:18:45.621701 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 360/724] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Aug 31 19:18:45 2022] DELETE /compute/v2.1/servers/b685acd5-7b0d-481c-8564-d7908f33abfa/os-volume_attachments/d1d5aa12-9585-45e0-a3da-eff9d3007a15 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:18:47.798319 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:47.799093 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:47.803528 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-f8974269-7f82-44a5-8913-461f833c56f6 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:47.804109 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-f8974269-7f82-44a5-8913-461f833c56f6 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: b685acd5-7b0d-481c-8564-d7908f33abfa] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:47.813297 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f8974269-7f82-44a5-8913-461f833c56f6 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:47.813890 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f8974269-7f82-44a5-8913-461f833c56f6 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:47.814898 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f8974269-7f82-44a5-8913-461f833c56f6 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:47.815197 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f8974269-7f82-44a5-8913-461f833c56f6 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:47.815745 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f8974269-7f82-44a5-8913-461f833c56f6 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:47.816513 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f8974269-7f82-44a5-8913-461f833c56f6 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:47.842415 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-f8974269-7f82-44a5-8913-461f833c56f6 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: b685acd5-7b0d-481c-8564-d7908f33abfa] Going to try to terminate instance {{(pid=120624) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 19:18:47.915633 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-f8974269-7f82-44a5-8913-461f833c56f6 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] 10.222.0.65 "DELETE /compute/v2.1/servers/b685acd5-7b0d-481c-8564-d7908f33abfa" status: 204 len: 0 microversion: 2.1 time: 0.117918 Aug 31 19:18:47.916281 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 365/725] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 31 19:18:47 2022] DELETE /compute/v2.1/servers/b685acd5-7b0d-481c-8564-d7908f33abfa => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:18:47.925356 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-ff40288d-4933-4b77-ab6f-f27dfbcd6ff3 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:47.926096 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-ff40288d-4933-4b77-ab6f-f27dfbcd6ff3 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: b685acd5-7b0d-481c-8564-d7908f33abfa] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:47.932258 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ff40288d-4933-4b77-ab6f-f27dfbcd6ff3 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:47.932733 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ff40288d-4933-4b77-ab6f-f27dfbcd6ff3 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:47.933156 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ff40288d-4933-4b77-ab6f-f27dfbcd6ff3 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:47.933854 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ff40288d-4933-4b77-ab6f-f27dfbcd6ff3 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:47.934331 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ff40288d-4933-4b77-ab6f-f27dfbcd6ff3 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:47.934747 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ff40288d-4933-4b77-ab6f-f27dfbcd6ff3 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:48.067861 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-ff40288d-4933-4b77-ab6f-f27dfbcd6ff3 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b8da543ad543bb95881450e4f9b585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5f61674804f93bd2127fc76919bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:48.076269 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-ff40288d-4933-4b77-ab6f-f27dfbcd6ff3 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] 10.222.0.65 "GET /compute/v2.1/servers/b685acd5-7b0d-481c-8564-d7908f33abfa" status: 200 len: 1514 microversion: 2.1 time: 0.155509 Aug 31 19:18:48.076833 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 361/726] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:47 2022] GET /compute/v2.1/servers/b685acd5-7b0d-481c-8564-d7908f33abfa => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:49.097681 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-89570271-2ba6-47b1-87f3-58a121e5531d tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:49.098370 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-89570271-2ba6-47b1-87f3-58a121e5531d tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: b685acd5-7b0d-481c-8564-d7908f33abfa] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:49.105032 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-89570271-2ba6-47b1-87f3-58a121e5531d tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:49.105539 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-89570271-2ba6-47b1-87f3-58a121e5531d tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:49.105968 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-89570271-2ba6-47b1-87f3-58a121e5531d tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:49.106647 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-89570271-2ba6-47b1-87f3-58a121e5531d tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:49.107096 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-89570271-2ba6-47b1-87f3-58a121e5531d tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:49.107513 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-89570271-2ba6-47b1-87f3-58a121e5531d tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:49.237269 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-89570271-2ba6-47b1-87f3-58a121e5531d tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b8da543ad543bb95881450e4f9b585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5f61674804f93bd2127fc76919bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:49.244905 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-89570271-2ba6-47b1-87f3-58a121e5531d tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] 10.222.0.65 "GET /compute/v2.1/servers/b685acd5-7b0d-481c-8564-d7908f33abfa" status: 200 len: 1514 microversion: 2.1 time: 0.151500 Aug 31 19:18:49.245516 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 366/727] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:49 2022] GET /compute/v2.1/servers/b685acd5-7b0d-481c-8564-d7908f33abfa => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:50.265544 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-b0719f2f-4b1a-4742-8d52-0b6d655d03b2 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:50.266260 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-b0719f2f-4b1a-4742-8d52-0b6d655d03b2 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: b685acd5-7b0d-481c-8564-d7908f33abfa] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:50.272685 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b0719f2f-4b1a-4742-8d52-0b6d655d03b2 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:50.273165 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b0719f2f-4b1a-4742-8d52-0b6d655d03b2 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:50.274167 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b0719f2f-4b1a-4742-8d52-0b6d655d03b2 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:50.274910 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b0719f2f-4b1a-4742-8d52-0b6d655d03b2 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:50.275364 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b0719f2f-4b1a-4742-8d52-0b6d655d03b2 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:50.275791 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b0719f2f-4b1a-4742-8d52-0b6d655d03b2 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:50.499967 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-b0719f2f-4b1a-4742-8d52-0b6d655d03b2 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b8da543ad543bb95881450e4f9b585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5f61674804f93bd2127fc76919bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:50.507627 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-b0719f2f-4b1a-4742-8d52-0b6d655d03b2 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] 10.222.0.65 "GET /compute/v2.1/servers/b685acd5-7b0d-481c-8564-d7908f33abfa" status: 200 len: 1514 microversion: 2.1 time: 0.246197 Aug 31 19:18:50.508741 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 362/728] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:50 2022] GET /compute/v2.1/servers/b685acd5-7b0d-481c-8564-d7908f33abfa => generated 1514 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:50.769297 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-67d795a2-58e7-49ce-831e-d3fc2e12577d req-747e242d-42f2-4e35-8151-e8ba732df559 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b685acd5-7b0d-481c-8564-d7908f33abfa", "name": "network-vif-deleted", "tag": "ee49acee-f0d6-48ab-9607-47759bd3a358"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:18:50.781524 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-67d795a2-58e7-49ce-831e-d3fc2e12577d req-747e242d-42f2-4e35-8151-e8ba732df559 service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:50.782003 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-67d795a2-58e7-49ce-831e-d3fc2e12577d req-747e242d-42f2-4e35-8151-e8ba732df559 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:50.782553 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-67d795a2-58e7-49ce-831e-d3fc2e12577d req-747e242d-42f2-4e35-8151-e8ba732df559 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:50.793943 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-67d795a2-58e7-49ce-831e-d3fc2e12577d req-747e242d-42f2-4e35-8151-e8ba732df559 service nova] Creating event network-vif-deleted:ee49acee-f0d6-48ab-9607-47759bd3a358 for instance b685acd5-7b0d-481c-8564-d7908f33abfa on hv-cinder-83538 Aug 31 19:18:50.799200 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-67d795a2-58e7-49ce-831e-d3fc2e12577d req-747e242d-42f2-4e35-8151-e8ba732df559 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033590 Aug 31 19:18:50.799872 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 367/729] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:18:51.528444 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-93dc595e-b35a-4bee-87c2-a54f911a6269 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:51.529053 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-93dc595e-b35a-4bee-87c2-a54f911a6269 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: b685acd5-7b0d-481c-8564-d7908f33abfa] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:51.535458 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-93dc595e-b35a-4bee-87c2-a54f911a6269 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:51.535947 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-93dc595e-b35a-4bee-87c2-a54f911a6269 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:51.536381 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-93dc595e-b35a-4bee-87c2-a54f911a6269 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:51.537079 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-93dc595e-b35a-4bee-87c2-a54f911a6269 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:51.537597 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-93dc595e-b35a-4bee-87c2-a54f911a6269 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:51.538023 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-93dc595e-b35a-4bee-87c2-a54f911a6269 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:51.571881 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-93dc595e-b35a-4bee-87c2-a54f911a6269 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:51.572370 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-93dc595e-b35a-4bee-87c2-a54f911a6269 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:51.572805 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-93dc595e-b35a-4bee-87c2-a54f911a6269 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:51.573283 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.objects.instance [None req-93dc595e-b35a-4bee-87c2-a54f911a6269 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lazy-loading 'fault' on Instance uuid b685acd5-7b0d-481c-8564-d7908f33abfa {{(pid=120623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:18:51.615421 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-93dc595e-b35a-4bee-87c2-a54f911a6269 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b8da543ad543bb95881450e4f9b585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5f61674804f93bd2127fc76919bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:51.622633 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-93dc595e-b35a-4bee-87c2-a54f911a6269 tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] 10.222.0.65 "GET /compute/v2.1/servers/b685acd5-7b0d-481c-8564-d7908f33abfa" status: 200 len: 1309 microversion: 2.1 time: 0.098196 Aug 31 19:18:51.623249 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 363/730] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:51 2022] GET /compute/v2.1/servers/b685acd5-7b0d-481c-8564-d7908f33abfa => generated 1309 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:52.643983 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-ea7c752e-2a30-4d8f-9a51-cf4dac06566f tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:52.644687 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-ea7c752e-2a30-4d8f-9a51-cf4dac06566f tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] [instance: b685acd5-7b0d-481c-8564-d7908f33abfa] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:52.651890 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ea7c752e-2a30-4d8f-9a51-cf4dac06566f tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:52.652371 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ea7c752e-2a30-4d8f-9a51-cf4dac06566f tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:52.652804 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ea7c752e-2a30-4d8f-9a51-cf4dac06566f tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:52.653516 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ea7c752e-2a30-4d8f-9a51-cf4dac06566f tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:52.653969 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ea7c752e-2a30-4d8f-9a51-cf4dac06566f tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:52.654390 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ea7c752e-2a30-4d8f-9a51-cf4dac06566f tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:52.667517 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.wsgi [None req-ea7c752e-2a30-4d8f-9a51-cf4dac06566f tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] HTTP exception thrown: Instance b685acd5-7b0d-481c-8564-d7908f33abfa could not be found. Aug 31 19:18:52.669119 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-ea7c752e-2a30-4d8f-9a51-cf4dac06566f tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Request method failure captured: Aug 31 19:18:52.669119 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: request: GET /compute/v2.1/servers/b685acd5-7b0d-481c-8564-d7908f33abfa HTTP/1.1 Aug 31 19:18:52.669119 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept: application/json Aug 31 19:18:52.669119 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Aug 31 19:18:52.669119 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Connection: close Aug 31 19:18:52.669119 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Length: 0 Aug 31 19:18:52.669119 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Type: application/json Aug 31 19:18:52.669119 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Host: 10.222.0.65 Aug 31 19:18:52.669119 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Aug 31 19:18:52.669119 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Aug 31 19:18:52.669119 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjD7NdvbGltdLmCtEreaI2KduoXFqKrwgEn538cbhmjXVLJ86gUiU1gz8kmuYZNm6sQHz5W4NAPUK4mzLMaxEwaXl1e6YcJTL-w8fQ9WLeFUSgu_k4RuHnFTelz5yojuz2HV9CWaxAxgBGa46Mu0_bwPu-YT1CgFxONQ5seUiYmkGItUU Aug 31 19:18:52.669119 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Aug 31 19:18:52.669119 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Aug 31 19:18:52.669119 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Aug 31 19:18:52.669119 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Aug 31 19:18:52.669119 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Aug 31 19:18:52.669119 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Aug 31 19:18:52.669119 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Id: 08d5f61674804f93bd2127fc76919bd3 Aug 31 19:18:52.669119 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-VolumesSnapshotTestJSON-482199141 Aug 31 19:18:52.669119 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Role: member,reader Aug 31 19:18:52.669119 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Roles: member,reader Aug 31 19:18:52.670730 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/08d5f61674804f93bd2127fc76919bd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/08d5f61674804f93bd2127fc76919bd3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_08d5f61674804f93bd2127fc76919bd3", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/08d5f61674804f93bd2127fc76919bd3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:18:52.670730 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-VolumesSnapshotTestJSON-482199141 Aug 31 19:18:52.670730 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Id: 08d5f61674804f93bd2127fc76919bd3 Aug 31 19:18:52.670730 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-482199141 Aug 31 19:18:52.670730 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User: tempest-VolumesSnapshotTestJSON-482199141-project Aug 31 19:18:52.670730 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Aug 31 19:18:52.670730 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Aug 31 19:18:52.670730 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Id: b1b8da543ad543bb95881450e4f9b585 Aug 31 19:18:52.670730 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-VolumesSnapshotTestJSON-482199141-project Aug 31 19:18:52.670730 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: method: > Aug 31 19:18:52.670730 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: exception: Instance b685acd5-7b0d-481c-8564-d7908f33abfa could not be found. Aug 31 19:18:52.670730 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: action_args: {'id': 'b685acd5-7b0d-481c-8564-d7908f33abfa'} Aug 31 19:18:52.671827 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:18:52.671827 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:18:52.671827 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:18:52.671827 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:18:52.671827 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:18:52.671827 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:18:52.671827 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:18:52.671827 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:18:52.671827 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:18:52.671827 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:18:52.671827 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b685acd5-7b0d-481c-8564-d7908f33abfa could not be found. Aug 31 19:18:52.671827 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:18:52.671827 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:18:52.671827 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:18:52.671827 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:18:52.671827 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:18:52.671827 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:18:52.671827 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:18:52.671827 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:18:52.671827 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:18:52.673412 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:18:52.673412 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:18:52.673412 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:18:52.673412 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:18:52.673412 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:18:52.673412 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:18:52.673412 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:18:52.673412 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b685acd5-7b0d-481c-8564-d7908f33abfa could not be found. Aug 31 19:18:52.673412 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:18:52.673412 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:18:52.673412 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:18:52.673412 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:18:52.673412 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:18:52.673412 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:18:52.673412 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:18:52.673412 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:18:52.673412 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b685acd5-7b0d-481c-8564-d7908f33abfa could not be found. Aug 31 19:18:52.673412 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:18:52.674650 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-ea7c752e-2a30-4d8f-9a51-cf4dac06566f tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] Returning 404 to user: Instance b685acd5-7b0d-481c-8564-d7908f33abfa could not be found. {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:18:52.674650 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-ea7c752e-2a30-4d8f-9a51-cf4dac06566f tempest-VolumesSnapshotTestJSON-482199141 tempest-VolumesSnapshotTestJSON-482199141-project] 10.222.0.65 "GET /compute/v2.1/servers/b685acd5-7b0d-481c-8564-d7908f33abfa" status: 404 len: 111 microversion: 2.1 time: 0.031256 Aug 31 19:18:52.674650 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 368/731] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:52 2022] GET /compute/v2.1/servers/b685acd5-7b0d-481c-8564-d7908f33abfa => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:19:01.218831 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 19:19:01.219382 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Wed Aug 31 19:19:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857/os-volume_attachments (ip 10.222.0.65) !!! Aug 31 19:19:01.319768 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-56fd35ee-942e-410a-b688-7f292241a9b5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "32d4d022-6bdd-4cf6-9d9b-f0a1678c3869"}} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:19:01.322896 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-56fd35ee-942e-410a-b688-7f292241a9b5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:01.328813 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-56fd35ee-942e-410a-b688-7f292241a9b5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:01.329330 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-56fd35ee-942e-410a-b688-7f292241a9b5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:01.329759 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-56fd35ee-942e-410a-b688-7f292241a9b5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:01.330438 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-56fd35ee-942e-410a-b688-7f292241a9b5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:01.330888 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-56fd35ee-942e-410a-b688-7f292241a9b5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:01.331308 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-56fd35ee-942e-410a-b688-7f292241a9b5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:01.594710 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-56fd35ee-942e-410a-b688-7f292241a9b5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "POST /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.380880 Aug 31 19:19:01.595259 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 364/732] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 31 19:19:01 2022] POST /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857/os-volume_attachments => generated 194 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:19:10.169345 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-30c9ade4-1fbd-4af6-a602-1551696dfa6a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:19:10.171512 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-30c9ade4-1fbd-4af6-a602-1551696dfa6a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:10.174575 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:10.175215 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:10.182482 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-30c9ade4-1fbd-4af6-a602-1551696dfa6a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:10.182953 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-30c9ade4-1fbd-4af6-a602-1551696dfa6a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:10.183438 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-30c9ade4-1fbd-4af6-a602-1551696dfa6a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:10.184194 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-30c9ade4-1fbd-4af6-a602-1551696dfa6a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:10.184628 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-30c9ade4-1fbd-4af6-a602-1551696dfa6a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:10.185052 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-30c9ade4-1fbd-4af6-a602-1551696dfa6a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:10.210578 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.objects.instance [None req-30c9ade4-1fbd-4af6-a602-1551696dfa6a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lazy-loading 'flavor' on Instance uuid c81a2adf-d0a7-44b6-abf6-74f03fe93857 {{(pid=120624) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:19:10.387052 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-30c9ade4-1fbd-4af6-a602-1551696dfa6a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "POST /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857/action" status: 200 len: 32 microversion: 2.1 time: 0.221658 Aug 31 19:19:10.387633 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 369/733] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 31 19:19:10 2022] POST /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857/action => generated 32 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 19:19:10.398239 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-cd4c804f-41e6-4bbb-952d-d632355bcb60 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:10.398931 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-cd4c804f-41e6-4bbb-952d-d632355bcb60 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:10.405584 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cd4c804f-41e6-4bbb-952d-d632355bcb60 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:10.406079 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cd4c804f-41e6-4bbb-952d-d632355bcb60 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:10.406509 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cd4c804f-41e6-4bbb-952d-d632355bcb60 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:10.407748 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cd4c804f-41e6-4bbb-952d-d632355bcb60 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:10.408390 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cd4c804f-41e6-4bbb-952d-d632355bcb60 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:10.408819 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cd4c804f-41e6-4bbb-952d-d632355bcb60 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:10.626133 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-cd4c804f-41e6-4bbb-952d-d632355bcb60 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:10.637268 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-cd4c804f-41e6-4bbb-952d-d632355bcb60 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1737 microversion: 2.1 time: 0.243644 Aug 31 19:19:10.637840 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 365/734] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:10 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1737 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:11.658704 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-79e82a71-8d59-43a0-a904-8eab8912ce18 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:11.659394 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-79e82a71-8d59-43a0-a904-8eab8912ce18 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:11.665621 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-79e82a71-8d59-43a0-a904-8eab8912ce18 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:11.666123 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-79e82a71-8d59-43a0-a904-8eab8912ce18 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:11.666550 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-79e82a71-8d59-43a0-a904-8eab8912ce18 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:11.667230 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-79e82a71-8d59-43a0-a904-8eab8912ce18 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:11.667675 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-79e82a71-8d59-43a0-a904-8eab8912ce18 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:11.668092 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-79e82a71-8d59-43a0-a904-8eab8912ce18 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:11.799315 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-79e82a71-8d59-43a0-a904-8eab8912ce18 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:11.807932 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-79e82a71-8d59-43a0-a904-8eab8912ce18 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1737 microversion: 2.1 time: 0.153950 Aug 31 19:19:11.808494 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 370/735] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:11 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:12.828130 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-8fc3256d-29c0-492c-8882-a515d55c7b6a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:12.828735 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-8fc3256d-29c0-492c-8882-a515d55c7b6a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:12.835360 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8fc3256d-29c0-492c-8882-a515d55c7b6a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:12.835877 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8fc3256d-29c0-492c-8882-a515d55c7b6a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:12.836313 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8fc3256d-29c0-492c-8882-a515d55c7b6a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:12.837002 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8fc3256d-29c0-492c-8882-a515d55c7b6a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:12.837495 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8fc3256d-29c0-492c-8882-a515d55c7b6a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:12.838434 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8fc3256d-29c0-492c-8882-a515d55c7b6a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:12.965172 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-8fc3256d-29c0-492c-8882-a515d55c7b6a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:12.973314 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-8fc3256d-29c0-492c-8882-a515d55c7b6a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1737 microversion: 2.1 time: 0.149025 Aug 31 19:19:12.973883 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 366/736] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:12 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:13.995954 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-3237efce-c4c8-44fb-a420-bde20ef339a3 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:13.996562 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-3237efce-c4c8-44fb-a420-bde20ef339a3 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:14.002912 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3237efce-c4c8-44fb-a420-bde20ef339a3 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:14.003382 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3237efce-c4c8-44fb-a420-bde20ef339a3 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:14.003802 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3237efce-c4c8-44fb-a420-bde20ef339a3 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:14.004474 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3237efce-c4c8-44fb-a420-bde20ef339a3 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:14.004910 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3237efce-c4c8-44fb-a420-bde20ef339a3 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:14.005345 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3237efce-c4c8-44fb-a420-bde20ef339a3 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:14.134251 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-3237efce-c4c8-44fb-a420-bde20ef339a3 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:14.142665 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-3237efce-c4c8-44fb-a420-bde20ef339a3 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1737 microversion: 2.1 time: 0.151734 Aug 31 19:19:14.143220 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 371/737] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:13 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:15.164425 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d838af74-eb0f-4aff-81e3-385895f91287 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:15.165258 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d838af74-eb0f-4aff-81e3-385895f91287 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:15.173738 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d838af74-eb0f-4aff-81e3-385895f91287 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:15.174221 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d838af74-eb0f-4aff-81e3-385895f91287 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:15.174649 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d838af74-eb0f-4aff-81e3-385895f91287 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:15.175330 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d838af74-eb0f-4aff-81e3-385895f91287 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:15.175777 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d838af74-eb0f-4aff-81e3-385895f91287 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:15.176243 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d838af74-eb0f-4aff-81e3-385895f91287 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:15.315360 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-d838af74-eb0f-4aff-81e3-385895f91287 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:15.323501 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-d838af74-eb0f-4aff-81e3-385895f91287 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1737 microversion: 2.1 time: 0.163540 Aug 31 19:19:15.324062 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 367/738] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:15 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:16.344385 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-2064d6b8-0883-4fb5-8608-a1fe146afc7e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:16.344962 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-2064d6b8-0883-4fb5-8608-a1fe146afc7e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:16.351553 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2064d6b8-0883-4fb5-8608-a1fe146afc7e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:16.352033 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2064d6b8-0883-4fb5-8608-a1fe146afc7e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:16.352465 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2064d6b8-0883-4fb5-8608-a1fe146afc7e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:16.353147 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2064d6b8-0883-4fb5-8608-a1fe146afc7e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:16.353626 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2064d6b8-0883-4fb5-8608-a1fe146afc7e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:16.354046 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2064d6b8-0883-4fb5-8608-a1fe146afc7e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:16.483002 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-2064d6b8-0883-4fb5-8608-a1fe146afc7e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:16.491047 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-2064d6b8-0883-4fb5-8608-a1fe146afc7e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1737 microversion: 2.1 time: 0.150724 Aug 31 19:19:16.491597 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 372/739] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:16 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:17.511537 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-6a8c4636-ae01-478b-bd30-aa856d8a9ebc tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:17.512135 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-6a8c4636-ae01-478b-bd30-aa856d8a9ebc tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:17.514512 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=19 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:17.519931 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6a8c4636-ae01-478b-bd30-aa856d8a9ebc tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:17.520402 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6a8c4636-ae01-478b-bd30-aa856d8a9ebc tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:17.520823 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6a8c4636-ae01-478b-bd30-aa856d8a9ebc tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:17.521522 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6a8c4636-ae01-478b-bd30-aa856d8a9ebc tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:17.521967 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6a8c4636-ae01-478b-bd30-aa856d8a9ebc tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:17.522381 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6a8c4636-ae01-478b-bd30-aa856d8a9ebc tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:17.524838 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:17.651659 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-6a8c4636-ae01-478b-bd30-aa856d8a9ebc tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:17.659789 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-6a8c4636-ae01-478b-bd30-aa856d8a9ebc tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1737 microversion: 2.1 time: 0.152081 Aug 31 19:19:17.660346 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 368/740] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:17 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:18.680182 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-ba913764-72c0-4447-86ab-32569ed05f68 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:18.680936 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-ba913764-72c0-4447-86ab-32569ed05f68 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:18.687553 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ba913764-72c0-4447-86ab-32569ed05f68 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:18.688036 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ba913764-72c0-4447-86ab-32569ed05f68 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:18.688459 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ba913764-72c0-4447-86ab-32569ed05f68 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:18.689139 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ba913764-72c0-4447-86ab-32569ed05f68 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:18.689725 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ba913764-72c0-4447-86ab-32569ed05f68 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:18.690137 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ba913764-72c0-4447-86ab-32569ed05f68 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:18.826928 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-ba913764-72c0-4447-86ab-32569ed05f68 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:18.839587 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-ba913764-72c0-4447-86ab-32569ed05f68 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1737 microversion: 2.1 time: 0.163025 Aug 31 19:19:18.840546 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 373/741] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:18 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:19.860823 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-bfe8c3af-5add-4667-9fe8-6ce2d24b45eb tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:19.861458 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-bfe8c3af-5add-4667-9fe8-6ce2d24b45eb tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:19.867826 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bfe8c3af-5add-4667-9fe8-6ce2d24b45eb tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:19.868301 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bfe8c3af-5add-4667-9fe8-6ce2d24b45eb tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:19.868729 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bfe8c3af-5add-4667-9fe8-6ce2d24b45eb tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:19.870052 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bfe8c3af-5add-4667-9fe8-6ce2d24b45eb tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:19.870503 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bfe8c3af-5add-4667-9fe8-6ce2d24b45eb tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:19.870925 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bfe8c3af-5add-4667-9fe8-6ce2d24b45eb tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:19.996028 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-bfe8c3af-5add-4667-9fe8-6ce2d24b45eb tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:20.004033 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-bfe8c3af-5add-4667-9fe8-6ce2d24b45eb tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1737 microversion: 2.1 time: 0.147120 Aug 31 19:19:20.004585 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 369/742] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:19 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:21.023854 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-0f6f8b10-d5aa-44d6-8aa4-e09bfe2db6f9 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:21.024464 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-0f6f8b10-d5aa-44d6-8aa4-e09bfe2db6f9 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:21.031508 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0f6f8b10-d5aa-44d6-8aa4-e09bfe2db6f9 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:21.032139 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0f6f8b10-d5aa-44d6-8aa4-e09bfe2db6f9 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:21.032571 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0f6f8b10-d5aa-44d6-8aa4-e09bfe2db6f9 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:21.033283 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0f6f8b10-d5aa-44d6-8aa4-e09bfe2db6f9 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:21.033732 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0f6f8b10-d5aa-44d6-8aa4-e09bfe2db6f9 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:21.034148 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0f6f8b10-d5aa-44d6-8aa4-e09bfe2db6f9 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:21.159754 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-0f6f8b10-d5aa-44d6-8aa4-e09bfe2db6f9 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:21.168434 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-0f6f8b10-d5aa-44d6-8aa4-e09bfe2db6f9 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1737 microversion: 2.1 time: 0.148553 Aug 31 19:19:21.168996 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 374/743] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:21 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:22.190200 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-5549283a-9e5c-4b32-be9e-2375d407ded4 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:22.190921 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-5549283a-9e5c-4b32-be9e-2375d407ded4 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:22.198145 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5549283a-9e5c-4b32-be9e-2375d407ded4 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:22.198640 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5549283a-9e5c-4b32-be9e-2375d407ded4 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:22.199071 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5549283a-9e5c-4b32-be9e-2375d407ded4 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:22.199771 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5549283a-9e5c-4b32-be9e-2375d407ded4 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:22.200299 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5549283a-9e5c-4b32-be9e-2375d407ded4 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:22.200753 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5549283a-9e5c-4b32-be9e-2375d407ded4 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:22.420601 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-5549283a-9e5c-4b32-be9e-2375d407ded4 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:22.429904 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-5549283a-9e5c-4b32-be9e-2375d407ded4 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1737 microversion: 2.1 time: 0.243650 Aug 31 19:19:22.430728 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 370/744] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:22 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1737 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:23.451579 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-08dd43c5-4b64-488a-a965-0e67c4cf7e62 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:23.452125 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-08dd43c5-4b64-488a-a965-0e67c4cf7e62 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:23.458747 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-08dd43c5-4b64-488a-a965-0e67c4cf7e62 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:23.459222 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-08dd43c5-4b64-488a-a965-0e67c4cf7e62 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:23.459651 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-08dd43c5-4b64-488a-a965-0e67c4cf7e62 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:23.460328 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-08dd43c5-4b64-488a-a965-0e67c4cf7e62 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:23.460774 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-08dd43c5-4b64-488a-a965-0e67c4cf7e62 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:23.461211 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-08dd43c5-4b64-488a-a965-0e67c4cf7e62 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:23.594996 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-08dd43c5-4b64-488a-a965-0e67c4cf7e62 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:23.604081 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-08dd43c5-4b64-488a-a965-0e67c4cf7e62 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1737 microversion: 2.1 time: 0.155846 Aug 31 19:19:23.604659 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 375/745] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:23 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:24.625284 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-8bda3014-68ba-4a13-97ff-883a14d1d028 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:24.625916 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-8bda3014-68ba-4a13-97ff-883a14d1d028 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:24.632350 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8bda3014-68ba-4a13-97ff-883a14d1d028 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:24.632829 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8bda3014-68ba-4a13-97ff-883a14d1d028 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:24.633291 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8bda3014-68ba-4a13-97ff-883a14d1d028 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:24.633975 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8bda3014-68ba-4a13-97ff-883a14d1d028 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:24.634426 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8bda3014-68ba-4a13-97ff-883a14d1d028 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:24.635485 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8bda3014-68ba-4a13-97ff-883a14d1d028 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:24.761857 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-8bda3014-68ba-4a13-97ff-883a14d1d028 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:24.770087 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-8bda3014-68ba-4a13-97ff-883a14d1d028 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1737 microversion: 2.1 time: 0.148675 Aug 31 19:19:24.770648 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 371/746] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:24 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:25.790813 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-21ea6d1a-319e-4067-814f-2419f33f1c60 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:25.791452 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-21ea6d1a-319e-4067-814f-2419f33f1c60 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:25.797871 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-21ea6d1a-319e-4067-814f-2419f33f1c60 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:25.798344 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-21ea6d1a-319e-4067-814f-2419f33f1c60 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:25.798763 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-21ea6d1a-319e-4067-814f-2419f33f1c60 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:25.799488 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-21ea6d1a-319e-4067-814f-2419f33f1c60 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:25.799928 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-21ea6d1a-319e-4067-814f-2419f33f1c60 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:25.800337 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-21ea6d1a-319e-4067-814f-2419f33f1c60 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:25.926787 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-21ea6d1a-319e-4067-814f-2419f33f1c60 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:25.934864 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-21ea6d1a-319e-4067-814f-2419f33f1c60 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1737 microversion: 2.1 time: 0.147934 Aug 31 19:19:25.935458 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 376/747] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:25 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:26.956191 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-a787d663-4c42-4446-823a-4b4c5263c877 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:26.956803 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-a787d663-4c42-4446-823a-4b4c5263c877 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:26.963871 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a787d663-4c42-4446-823a-4b4c5263c877 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:26.964351 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a787d663-4c42-4446-823a-4b4c5263c877 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:26.964807 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a787d663-4c42-4446-823a-4b4c5263c877 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:26.965540 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a787d663-4c42-4446-823a-4b4c5263c877 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:26.965992 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a787d663-4c42-4446-823a-4b4c5263c877 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:26.966418 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a787d663-4c42-4446-823a-4b4c5263c877 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:27.092159 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-a787d663-4c42-4446-823a-4b4c5263c877 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:27.100560 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-a787d663-4c42-4446-823a-4b4c5263c877 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1737 microversion: 2.1 time: 0.148128 Aug 31 19:19:27.101117 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 372/748] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:26 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:28.122734 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-dd723d2c-b1bb-4734-9dd3-d01bac118685 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:28.123263 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-dd723d2c-b1bb-4734-9dd3-d01bac118685 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:28.129658 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dd723d2c-b1bb-4734-9dd3-d01bac118685 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:28.130137 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dd723d2c-b1bb-4734-9dd3-d01bac118685 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:28.130567 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dd723d2c-b1bb-4734-9dd3-d01bac118685 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:28.131255 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dd723d2c-b1bb-4734-9dd3-d01bac118685 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:28.131702 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dd723d2c-b1bb-4734-9dd3-d01bac118685 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:28.132115 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dd723d2c-b1bb-4734-9dd3-d01bac118685 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:28.267749 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-dd723d2c-b1bb-4734-9dd3-d01bac118685 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:28.276438 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-dd723d2c-b1bb-4734-9dd3-d01bac118685 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1737 microversion: 2.1 time: 0.157890 Aug 31 19:19:28.276991 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 377/749] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:28 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:29.296682 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-3a9c09ff-c9f8-463c-b0d3-807202a58457 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:29.297317 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-3a9c09ff-c9f8-463c-b0d3-807202a58457 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:29.303711 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3a9c09ff-c9f8-463c-b0d3-807202a58457 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:29.304194 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3a9c09ff-c9f8-463c-b0d3-807202a58457 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:29.304627 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3a9c09ff-c9f8-463c-b0d3-807202a58457 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:29.305341 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3a9c09ff-c9f8-463c-b0d3-807202a58457 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:29.305799 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3a9c09ff-c9f8-463c-b0d3-807202a58457 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:29.306227 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3a9c09ff-c9f8-463c-b0d3-807202a58457 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:29.434887 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-3a9c09ff-c9f8-463c-b0d3-807202a58457 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:29.443002 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-3a9c09ff-c9f8-463c-b0d3-807202a58457 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1737 microversion: 2.1 time: 0.150230 Aug 31 19:19:29.443567 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 373/750] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:29 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:30.463217 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-813c4798-60a1-4b9a-8f2e-d9bd151dbc0e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:30.464416 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-813c4798-60a1-4b9a-8f2e-d9bd151dbc0e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:30.470928 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-813c4798-60a1-4b9a-8f2e-d9bd151dbc0e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:30.471433 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-813c4798-60a1-4b9a-8f2e-d9bd151dbc0e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:30.471884 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-813c4798-60a1-4b9a-8f2e-d9bd151dbc0e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:30.472634 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-813c4798-60a1-4b9a-8f2e-d9bd151dbc0e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:30.473093 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-813c4798-60a1-4b9a-8f2e-d9bd151dbc0e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:30.473539 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-813c4798-60a1-4b9a-8f2e-d9bd151dbc0e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:30.603554 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-813c4798-60a1-4b9a-8f2e-d9bd151dbc0e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:30.611680 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-813c4798-60a1-4b9a-8f2e-d9bd151dbc0e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1717 microversion: 2.1 time: 0.152386 Aug 31 19:19:30.612242 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 378/751] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:30 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1717 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:30.720312 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-7cbe3b00-2cf8-4fd7-ab9b-731827134a08 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:30.720819 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-7cbe3b00-2cf8-4fd7-ab9b-731827134a08 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:30.727346 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7cbe3b00-2cf8-4fd7-ab9b-731827134a08 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:30.727824 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7cbe3b00-2cf8-4fd7-ab9b-731827134a08 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:30.728253 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7cbe3b00-2cf8-4fd7-ab9b-731827134a08 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:30.728938 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7cbe3b00-2cf8-4fd7-ab9b-731827134a08 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:30.729446 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7cbe3b00-2cf8-4fd7-ab9b-731827134a08 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:30.729868 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7cbe3b00-2cf8-4fd7-ab9b-731827134a08 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:30.808247 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.wsgi [None req-7cbe3b00-2cf8-4fd7-ab9b-731827134a08 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] HTTP exception thrown: Cannot 'detach_volume' instance c81a2adf-d0a7-44b6-abf6-74f03fe93857 while it is in vm_state rescued Aug 31 19:19:30.809907 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-7cbe3b00-2cf8-4fd7-ab9b-731827134a08 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Request method failure captured: Aug 31 19:19:30.809907 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: request: DELETE /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857/os-volume_attachments/32d4d022-6bdd-4cf6-9d9b-f0a1678c3869 HTTP/1.1 Aug 31 19:19:30.809907 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Accept: application/json Aug 31 19:19:30.809907 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Accept-Encoding: identity Aug 31 19:19:30.809907 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Connection: close Aug 31 19:19:30.809907 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Content-Length: 0 Aug 31 19:19:30.809907 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Content-Type: application/json Aug 31 19:19:30.809907 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Host: 10.222.0.65 Aug 31 19:19:30.809907 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Openstack-System-Scope: None Aug 31 19:19:30.809907 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: User-Agent: python-urllib3/1.26.12 Aug 31 19:19:30.809907 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Auth-Token: gAAAAABjD7KOlBALRYg9399MMb60KjA4ASvzgtL1fbEjfGfYKkQDFDd34Xyka_n4-xuhW1XYCsQfE8u_kNDZeL9oEdunAB6QbQoi_8yNGy9km4X1NZ-R1OWPUKtY-9EToi-YGlRmDnKh4j-19QgSeWbL8e8I_blzc8DpEbhUiI4vF3YAGNOsMLo Aug 31 19:19:30.809907 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Domain-Id: None Aug 31 19:19:30.809907 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Domain-Name: None Aug 31 19:19:30.809907 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Identity-Status: Confirmed Aug 31 19:19:30.809907 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Is-Admin-Project: True Aug 31 19:19:30.809907 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Id: default Aug 31 19:19:30.809907 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Name: Default Aug 31 19:19:30.809907 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Id: e3aa913bb25c45039643ce87bb84cbc2 Aug 31 19:19:30.809907 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-30468556 Aug 31 19:19:30.809907 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Role: member,reader Aug 31 19:19:30.809907 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Roles: member,reader Aug 31 19:19:30.811814 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/e3aa913bb25c45039643ce87bb84cbc2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e3aa913bb25c45039643ce87bb84cbc2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_e3aa913bb25c45039643ce87bb84cbc2", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e3aa913bb25c45039643ce87bb84cbc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:19:30.811814 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant: tempest-ServerRescueNegativeTestJSON-30468556 Aug 31 19:19:30.811814 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant-Id: e3aa913bb25c45039643ce87bb84cbc2 Aug 31 19:19:30.811814 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-30468556 Aug 31 19:19:30.811814 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User: tempest-ServerRescueNegativeTestJSON-30468556-project Aug 31 19:19:30.811814 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Id: default Aug 31 19:19:30.811814 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Name: Default Aug 31 19:19:30.811814 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Id: aa81a686e4324370a20e3fc35e5cc7a5 Aug 31 19:19:30.811814 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Name: tempest-ServerRescueNegativeTestJSON-30468556-project Aug 31 19:19:30.811814 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: method: > Aug 31 19:19:30.811814 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: exception: Cannot 'detach_volume' instance c81a2adf-d0a7-44b6-abf6-74f03fe93857 while it is in vm_state rescued Aug 31 19:19:30.812508 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: action_args: {'server_id': 'c81a2adf-d0a7-44b6-abf6-74f03fe93857', 'id': '32d4d022-6bdd-4cf6-9d9b-f0a1678c3869'} Aug 31 19:19:30.812508 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:19:30.812508 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:19:30.812508 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 31 19:19:30.812508 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 31 19:19:30.812508 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 19:19:30.812508 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 19:19:30.812508 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 19:19:30.812508 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 19:19:30.812508 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c81a2adf-d0a7-44b6-abf6-74f03fe93857 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 31 19:19:30.812508 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:19:30.812508 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:19:30.812508 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:19:30.812508 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:19:30.812508 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:19:30.812508 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:19:30.812508 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:19:30.812508 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:19:30.812508 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:19:30.812508 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:19:30.813897 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 31 19:19:30.813897 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 19:19:30.813897 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 19:19:30.813897 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 19:19:30.813897 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance c81a2adf-d0a7-44b6-abf6-74f03fe93857 while it is in vm_state rescued Aug 31 19:19:30.813897 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:19:30.813897 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:19:30.813897 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:19:30.813897 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:19:30.813897 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:19:30.813897 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:19:30.813897 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:19:30.813897 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:19:30.813897 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance c81a2adf-d0a7-44b6-abf6-74f03fe93857 while it is in vm_state rescued Aug 31 19:19:30.813897 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:19:30.813897 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-7cbe3b00-2cf8-4fd7-ab9b-731827134a08 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Returning 409 to user: Cannot 'detach_volume' instance c81a2adf-d0a7-44b6-abf6-74f03fe93857 while it is in vm_state rescued {{(pid=120623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:19:30.814918 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-7cbe3b00-2cf8-4fd7-ab9b-731827134a08 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "DELETE /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857/os-volume_attachments/32d4d022-6bdd-4cf6-9d9b-f0a1678c3869" status: 409 len: 152 microversion: 2.1 time: 0.095145 Aug 31 19:19:30.814918 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 374/752] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Aug 31 19:19:30 2022] DELETE /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857/os-volume_attachments/32d4d022-6bdd-4cf6-9d9b-f0a1678c3869 => generated 152 bytes in 96 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 19:19:30.820226 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-6b94b6ad-6803-4d81-9894-cffa21d7e9c6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:19:30.820760 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-6b94b6ad-6803-4d81-9894-cffa21d7e9c6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:30.827311 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6b94b6ad-6803-4d81-9894-cffa21d7e9c6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:30.827792 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6b94b6ad-6803-4d81-9894-cffa21d7e9c6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:30.828223 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6b94b6ad-6803-4d81-9894-cffa21d7e9c6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:30.828917 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6b94b6ad-6803-4d81-9894-cffa21d7e9c6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:30.829407 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6b94b6ad-6803-4d81-9894-cffa21d7e9c6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:30.829830 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6b94b6ad-6803-4d81-9894-cffa21d7e9c6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:30.894553 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-6b94b6ad-6803-4d81-9894-cffa21d7e9c6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "POST /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857/action" status: 202 len: 0 microversion: 2.1 time: 0.077933 Aug 31 19:19:30.895180 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 379/753] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 31 19:19:30 2022] POST /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:19:30.903283 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-649649c0-3595-4525-bd00-4512dec86819 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:30.903896 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-649649c0-3595-4525-bd00-4512dec86819 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:30.909894 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-649649c0-3595-4525-bd00-4512dec86819 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:30.910372 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-649649c0-3595-4525-bd00-4512dec86819 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:30.910798 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-649649c0-3595-4525-bd00-4512dec86819 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:30.911486 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-649649c0-3595-4525-bd00-4512dec86819 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:30.911939 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-649649c0-3595-4525-bd00-4512dec86819 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:30.912356 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-649649c0-3595-4525-bd00-4512dec86819 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:31.046782 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-649649c0-3595-4525-bd00-4512dec86819 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:31.055253 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-649649c0-3595-4525-bd00-4512dec86819 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1725 microversion: 2.1 time: 0.155703 Aug 31 19:19:31.055924 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 375/754] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:30 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:32.078994 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-2da65603-f1bb-425a-b9c7-4cf1cdc8e238 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:32.079688 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-2da65603-f1bb-425a-b9c7-4cf1cdc8e238 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:32.085800 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2da65603-f1bb-425a-b9c7-4cf1cdc8e238 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:32.086270 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2da65603-f1bb-425a-b9c7-4cf1cdc8e238 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:32.086695 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2da65603-f1bb-425a-b9c7-4cf1cdc8e238 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:32.087372 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2da65603-f1bb-425a-b9c7-4cf1cdc8e238 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:32.087818 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2da65603-f1bb-425a-b9c7-4cf1cdc8e238 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:32.088231 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2da65603-f1bb-425a-b9c7-4cf1cdc8e238 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:32.216232 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-2da65603-f1bb-425a-b9c7-4cf1cdc8e238 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:32.224520 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-2da65603-f1bb-425a-b9c7-4cf1cdc8e238 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1725 microversion: 2.1 time: 0.150429 Aug 31 19:19:32.225358 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 380/755] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:32 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:33.245633 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-a5795bda-2bf7-4877-928d-c5c8a51f9f02 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:33.246244 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-a5795bda-2bf7-4877-928d-c5c8a51f9f02 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:33.252676 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a5795bda-2bf7-4877-928d-c5c8a51f9f02 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:33.253161 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a5795bda-2bf7-4877-928d-c5c8a51f9f02 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:33.253627 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a5795bda-2bf7-4877-928d-c5c8a51f9f02 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:33.254318 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a5795bda-2bf7-4877-928d-c5c8a51f9f02 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:33.254773 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a5795bda-2bf7-4877-928d-c5c8a51f9f02 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:33.255197 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a5795bda-2bf7-4877-928d-c5c8a51f9f02 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:33.380800 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-a5795bda-2bf7-4877-928d-c5c8a51f9f02 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:33.389440 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-a5795bda-2bf7-4877-928d-c5c8a51f9f02 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1725 microversion: 2.1 time: 0.147653 Aug 31 19:19:33.390000 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 376/756] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:33 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:34.411041 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-2b3f61ff-30fe-4f36-8fee-719ebd23f7ec tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:34.411645 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-2b3f61ff-30fe-4f36-8fee-719ebd23f7ec tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:34.418845 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2b3f61ff-30fe-4f36-8fee-719ebd23f7ec tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:34.419331 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2b3f61ff-30fe-4f36-8fee-719ebd23f7ec tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:34.419985 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2b3f61ff-30fe-4f36-8fee-719ebd23f7ec tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:34.420669 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2b3f61ff-30fe-4f36-8fee-719ebd23f7ec tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:34.421276 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2b3f61ff-30fe-4f36-8fee-719ebd23f7ec tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:34.421697 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2b3f61ff-30fe-4f36-8fee-719ebd23f7ec tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:34.556606 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-2b3f61ff-30fe-4f36-8fee-719ebd23f7ec tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:34.564924 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-2b3f61ff-30fe-4f36-8fee-719ebd23f7ec tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1725 microversion: 2.1 time: 0.157768 Aug 31 19:19:34.565531 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 381/757] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:34 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:35.585903 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-4606ecb1-c995-41bf-9b21-e096714b195f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:35.586546 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-4606ecb1-c995-41bf-9b21-e096714b195f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:35.593092 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4606ecb1-c995-41bf-9b21-e096714b195f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:35.593607 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4606ecb1-c995-41bf-9b21-e096714b195f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:35.594060 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4606ecb1-c995-41bf-9b21-e096714b195f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:35.594741 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4606ecb1-c995-41bf-9b21-e096714b195f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:35.595195 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4606ecb1-c995-41bf-9b21-e096714b195f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:35.595616 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4606ecb1-c995-41bf-9b21-e096714b195f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:35.723594 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-4606ecb1-c995-41bf-9b21-e096714b195f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:35.732487 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-4606ecb1-c995-41bf-9b21-e096714b195f tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1731 microversion: 2.1 time: 0.150409 Aug 31 19:19:35.733055 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 377/758] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:35 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:35.752370 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-1dd86064-3b8a-4c29-84ec-14b3a186ee22 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:35.752871 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-1dd86064-3b8a-4c29-84ec-14b3a186ee22 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:35.759101 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1dd86064-3b8a-4c29-84ec-14b3a186ee22 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:35.759570 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1dd86064-3b8a-4c29-84ec-14b3a186ee22 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:35.759993 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1dd86064-3b8a-4c29-84ec-14b3a186ee22 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:35.760694 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1dd86064-3b8a-4c29-84ec-14b3a186ee22 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:35.761137 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1dd86064-3b8a-4c29-84ec-14b3a186ee22 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:35.761598 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1dd86064-3b8a-4c29-84ec-14b3a186ee22 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:35.780153 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:35.841948 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-1dd86064-3b8a-4c29-84ec-14b3a186ee22 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093315 Aug 31 19:19:35.842537 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 382/759] 10.222.0.65 () {58 vars in 1275 bytes} [Wed Aug 31 19:19:35 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:19:36.716425 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-c52fa112-2bd7-497d-b97e-5e0ef7a38e58 req-f0bb58d1-e41c-448a-b73f-f6e2d62be940 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c81a2adf-d0a7-44b6-abf6-74f03fe93857", "tag": "2ccb095c-a665-47ff-bcff-65a4dc08d119"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:19:36.726663 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-c52fa112-2bd7-497d-b97e-5e0ef7a38e58 req-f0bb58d1-e41c-448a-b73f-f6e2d62be940 service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:36.727169 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-c52fa112-2bd7-497d-b97e-5e0ef7a38e58 req-f0bb58d1-e41c-448a-b73f-f6e2d62be940 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:36.727597 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-c52fa112-2bd7-497d-b97e-5e0ef7a38e58 req-f0bb58d1-e41c-448a-b73f-f6e2d62be940 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:36.739161 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-c52fa112-2bd7-497d-b97e-5e0ef7a38e58 req-f0bb58d1-e41c-448a-b73f-f6e2d62be940 service nova] Creating event network-changed:2ccb095c-a665-47ff-bcff-65a4dc08d119 for instance c81a2adf-d0a7-44b6-abf6-74f03fe93857 on hv-cinder-83538 Aug 31 19:19:36.747949 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-c52fa112-2bd7-497d-b97e-5e0ef7a38e58 req-f0bb58d1-e41c-448a-b73f-f6e2d62be940 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035125 Aug 31 19:19:36.748545 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 378/760] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:19:38.763340 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-e2d63996-f7b4-438d-9825-fff8b9018610 req-726c0e76-6a8e-4904-8e0e-7588870c1b3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c81a2adf-d0a7-44b6-abf6-74f03fe93857", "tag": "2ccb095c-a665-47ff-bcff-65a4dc08d119"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:19:38.772577 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-e2d63996-f7b4-438d-9825-fff8b9018610 req-726c0e76-6a8e-4904-8e0e-7588870c1b3f service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:38.773053 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-e2d63996-f7b4-438d-9825-fff8b9018610 req-726c0e76-6a8e-4904-8e0e-7588870c1b3f service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:38.773522 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-e2d63996-f7b4-438d-9825-fff8b9018610 req-726c0e76-6a8e-4904-8e0e-7588870c1b3f service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:38.784639 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-e2d63996-f7b4-438d-9825-fff8b9018610 req-726c0e76-6a8e-4904-8e0e-7588870c1b3f service nova] Creating event network-changed:2ccb095c-a665-47ff-bcff-65a4dc08d119 for instance c81a2adf-d0a7-44b6-abf6-74f03fe93857 on hv-cinder-83538 Aug 31 19:19:38.789613 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-e2d63996-f7b4-438d-9825-fff8b9018610 req-726c0e76-6a8e-4904-8e0e-7588870c1b3f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030605 Aug 31 19:19:38.790186 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 379/761] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:19:38.918715 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-2f65efa7-858c-4048-9d37-f4ae2aa31f6b tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:19:38.919223 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-2f65efa7-858c-4048-9d37-f4ae2aa31f6b tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:38.925028 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2f65efa7-858c-4048-9d37-f4ae2aa31f6b tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:38.925538 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2f65efa7-858c-4048-9d37-f4ae2aa31f6b tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:38.925965 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2f65efa7-858c-4048-9d37-f4ae2aa31f6b tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:38.926648 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2f65efa7-858c-4048-9d37-f4ae2aa31f6b tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:38.927096 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2f65efa7-858c-4048-9d37-f4ae2aa31f6b tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:38.927516 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2f65efa7-858c-4048-9d37-f4ae2aa31f6b tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:38.950420 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.objects.instance [None req-2f65efa7-858c-4048-9d37-f4ae2aa31f6b tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lazy-loading 'flavor' on Instance uuid 52d843ca-5f08-47f6-98dc-2df1d30438cc {{(pid=120624) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:19:39.026746 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-2f65efa7-858c-4048-9d37-f4ae2aa31f6b tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "POST /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc/action" status: 202 len: 0 microversion: 2.1 time: 0.275589 Aug 31 19:19:39.027362 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 383/762] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 31 19:19:38 2022] POST /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc/action => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:19:39.036171 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-f8b16e46-1962-4b70-bd7d-5e2e498e13ca tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:39.036869 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-f8b16e46-1962-4b70-bd7d-5e2e498e13ca tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:39.043850 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f8b16e46-1962-4b70-bd7d-5e2e498e13ca tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:39.044335 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f8b16e46-1962-4b70-bd7d-5e2e498e13ca tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:39.044949 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f8b16e46-1962-4b70-bd7d-5e2e498e13ca tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:39.045855 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f8b16e46-1962-4b70-bd7d-5e2e498e13ca tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:39.046470 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f8b16e46-1962-4b70-bd7d-5e2e498e13ca tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:39.046895 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f8b16e46-1962-4b70-bd7d-5e2e498e13ca tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:39.218730 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-f8b16e46-1962-4b70-bd7d-5e2e498e13ca tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:39.226702 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-f8b16e46-1962-4b70-bd7d-5e2e498e13ca tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1568 microversion: 2.1 time: 0.194654 Aug 31 19:19:39.227269 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 380/763] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:39 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1568 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:40.248719 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-037f8781-0b80-41c5-a901-f68ee89b23a7 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:40.249436 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-037f8781-0b80-41c5-a901-f68ee89b23a7 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:40.251451 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_api:SELECT=31 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:40.256798 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-037f8781-0b80-41c5-a901-f68ee89b23a7 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:40.257289 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-037f8781-0b80-41c5-a901-f68ee89b23a7 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:40.257711 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-037f8781-0b80-41c5-a901-f68ee89b23a7 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:40.258380 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-037f8781-0b80-41c5-a901-f68ee89b23a7 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:40.258821 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-037f8781-0b80-41c5-a901-f68ee89b23a7 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:40.259228 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-037f8781-0b80-41c5-a901-f68ee89b23a7 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:40.395155 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-037f8781-0b80-41c5-a901-f68ee89b23a7 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:40.403459 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-037f8781-0b80-41c5-a901-f68ee89b23a7 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1568 microversion: 2.1 time: 0.159404 Aug 31 19:19:40.404017 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 384/764] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:40 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:41.155145 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-7f7f2ed5-6a09-4132-8b1c-dfc5ddd205fa tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:19:41.157505 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-7f7f2ed5-6a09-4132-8b1c-dfc5ddd205fa tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] [instance: 5537ff84-8f70-4ba6-b219-09ffa1164d9a] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:41.164020 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7f7f2ed5-6a09-4132-8b1c-dfc5ddd205fa tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:41.164506 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7f7f2ed5-6a09-4132-8b1c-dfc5ddd205fa tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:41.164944 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7f7f2ed5-6a09-4132-8b1c-dfc5ddd205fa tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:41.165663 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7f7f2ed5-6a09-4132-8b1c-dfc5ddd205fa tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:41.166142 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7f7f2ed5-6a09-4132-8b1c-dfc5ddd205fa tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:41.166581 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7f7f2ed5-6a09-4132-8b1c-dfc5ddd205fa tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:41.240555 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-7f7f2ed5-6a09-4132-8b1c-dfc5ddd205fa tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] 10.222.0.65 "POST /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a/action" status: 202 len: 0 microversion: 2.1 time: 0.089226 Aug 31 19:19:41.241208 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 381/765] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 31 19:19:41 2022] POST /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:19:41.250690 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-3ebc36eb-922b-4579-ab2d-bcdd59380d49 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:41.251303 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-3ebc36eb-922b-4579-ab2d-bcdd59380d49 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] [instance: 5537ff84-8f70-4ba6-b219-09ffa1164d9a] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:41.258281 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3ebc36eb-922b-4579-ab2d-bcdd59380d49 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:41.258946 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3ebc36eb-922b-4579-ab2d-bcdd59380d49 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:41.259417 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3ebc36eb-922b-4579-ab2d-bcdd59380d49 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:41.261217 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3ebc36eb-922b-4579-ab2d-bcdd59380d49 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:41.262194 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3ebc36eb-922b-4579-ab2d-bcdd59380d49 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:41.262624 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3ebc36eb-922b-4579-ab2d-bcdd59380d49 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:41.407018 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-3ebc36eb-922b-4579-ab2d-bcdd59380d49 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07fb9a216ac4683852fc6cae7c10b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8ee0bdd09b45599a7c19798660aac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:41.415251 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-3ebc36eb-922b-4579-ab2d-bcdd59380d49 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] 10.222.0.65 "GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a" status: 200 len: 1747 microversion: 2.1 time: 0.168504 Aug 31 19:19:41.415820 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 385/766] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:41 2022] GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a => generated 1747 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:41.427062 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-a08fbb1e-7d86-4148-b8db-34cfd8d09e33 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:41.427951 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-a08fbb1e-7d86-4148-b8db-34cfd8d09e33 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:41.435495 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a08fbb1e-7d86-4148-b8db-34cfd8d09e33 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:41.435978 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a08fbb1e-7d86-4148-b8db-34cfd8d09e33 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:41.436415 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a08fbb1e-7d86-4148-b8db-34cfd8d09e33 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:41.437107 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a08fbb1e-7d86-4148-b8db-34cfd8d09e33 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:41.437593 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a08fbb1e-7d86-4148-b8db-34cfd8d09e33 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:41.438019 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a08fbb1e-7d86-4148-b8db-34cfd8d09e33 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:41.633920 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-a08fbb1e-7d86-4148-b8db-34cfd8d09e33 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:41.641650 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-a08fbb1e-7d86-4148-b8db-34cfd8d09e33 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1568 microversion: 2.1 time: 0.218691 Aug 31 19:19:41.642223 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 382/767] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:41 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1568 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:42.438764 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-8f015074-f552-4cd1-848a-b64576b8ce9e tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:42.439366 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-8f015074-f552-4cd1-848a-b64576b8ce9e tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] [instance: 5537ff84-8f70-4ba6-b219-09ffa1164d9a] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:42.445861 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8f015074-f552-4cd1-848a-b64576b8ce9e tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:42.446382 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8f015074-f552-4cd1-848a-b64576b8ce9e tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:42.446751 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8f015074-f552-4cd1-848a-b64576b8ce9e tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:42.447418 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8f015074-f552-4cd1-848a-b64576b8ce9e tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:42.448361 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8f015074-f552-4cd1-848a-b64576b8ce9e tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:42.448777 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8f015074-f552-4cd1-848a-b64576b8ce9e tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:42.591597 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-8f015074-f552-4cd1-848a-b64576b8ce9e tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07fb9a216ac4683852fc6cae7c10b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8ee0bdd09b45599a7c19798660aac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:42.600185 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-8f015074-f552-4cd1-848a-b64576b8ce9e tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] 10.222.0.65 "GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a" status: 200 len: 1752 microversion: 2.1 time: 0.164990 Aug 31 19:19:42.600749 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 386/768] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:42 2022] GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a => generated 1752 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:42.662985 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-9b37342c-d82d-4a7e-b14f-9139d4684894 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:42.663593 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-9b37342c-d82d-4a7e-b14f-9139d4684894 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:42.670598 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9b37342c-d82d-4a7e-b14f-9139d4684894 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:42.671082 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9b37342c-d82d-4a7e-b14f-9139d4684894 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:42.671514 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9b37342c-d82d-4a7e-b14f-9139d4684894 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:42.672204 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9b37342c-d82d-4a7e-b14f-9139d4684894 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:42.672660 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9b37342c-d82d-4a7e-b14f-9139d4684894 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:42.673083 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9b37342c-d82d-4a7e-b14f-9139d4684894 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:42.799238 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-9b37342c-d82d-4a7e-b14f-9139d4684894 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:42.806910 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-9b37342c-d82d-4a7e-b14f-9139d4684894 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1568 microversion: 2.1 time: 0.147808 Aug 31 19:19:42.807480 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 383/769] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:42 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:43.621861 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-08f2ee19-3d3a-4e11-a931-cef8b96f065e tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:43.622454 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-08f2ee19-3d3a-4e11-a931-cef8b96f065e tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] [instance: 5537ff84-8f70-4ba6-b219-09ffa1164d9a] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:43.628821 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-08f2ee19-3d3a-4e11-a931-cef8b96f065e tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:43.629336 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-08f2ee19-3d3a-4e11-a931-cef8b96f065e tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:43.629772 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-08f2ee19-3d3a-4e11-a931-cef8b96f065e tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:43.630460 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-08f2ee19-3d3a-4e11-a931-cef8b96f065e tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:43.630914 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-08f2ee19-3d3a-4e11-a931-cef8b96f065e tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:43.631340 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-08f2ee19-3d3a-4e11-a931-cef8b96f065e tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:43.782152 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-08f2ee19-3d3a-4e11-a931-cef8b96f065e tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07fb9a216ac4683852fc6cae7c10b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8ee0bdd09b45599a7c19798660aac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:43.790363 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-08f2ee19-3d3a-4e11-a931-cef8b96f065e tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] 10.222.0.65 "GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a" status: 200 len: 1752 microversion: 2.1 time: 0.173004 Aug 31 19:19:43.790926 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 387/770] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:43 2022] GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a => generated 1752 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:43.827750 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-0ff52966-8077-4dc3-999e-a6832a30717b tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:43.828358 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-0ff52966-8077-4dc3-999e-a6832a30717b tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:43.834702 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0ff52966-8077-4dc3-999e-a6832a30717b tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:43.835182 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0ff52966-8077-4dc3-999e-a6832a30717b tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:43.835611 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0ff52966-8077-4dc3-999e-a6832a30717b tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:43.836292 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0ff52966-8077-4dc3-999e-a6832a30717b tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:43.836748 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0ff52966-8077-4dc3-999e-a6832a30717b tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:43.837168 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0ff52966-8077-4dc3-999e-a6832a30717b tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:43.967703 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-0ff52966-8077-4dc3-999e-a6832a30717b tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:43.975867 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-0ff52966-8077-4dc3-999e-a6832a30717b tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1568 microversion: 2.1 time: 0.151972 Aug 31 19:19:43.976425 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 384/771] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:43 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:19:44.811485 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-0a000b77-e1f7-4822-bdc4-685b3d983150 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:44.812082 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-0a000b77-e1f7-4822-bdc4-685b3d983150 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] [instance: 5537ff84-8f70-4ba6-b219-09ffa1164d9a] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:44.818498 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0a000b77-e1f7-4822-bdc4-685b3d983150 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:44.818969 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0a000b77-e1f7-4822-bdc4-685b3d983150 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:44.819391 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0a000b77-e1f7-4822-bdc4-685b3d983150 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:44.820066 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0a000b77-e1f7-4822-bdc4-685b3d983150 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:44.820508 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0a000b77-e1f7-4822-bdc4-685b3d983150 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:44.820918 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0a000b77-e1f7-4822-bdc4-685b3d983150 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:44.961503 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-0a000b77-e1f7-4822-bdc4-685b3d983150 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07fb9a216ac4683852fc6cae7c10b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8ee0bdd09b45599a7c19798660aac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:44.969531 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-0a000b77-e1f7-4822-bdc4-685b3d983150 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] 10.222.0.65 "GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a" status: 200 len: 1752 microversion: 2.1 time: 0.162350 Aug 31 19:19:44.970091 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 388/772] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:44 2022] GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a => generated 1752 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:44.998239 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-b3922f08-b37f-45c3-ac41-2614c83b317f tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:44.998842 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-b3922f08-b37f-45c3-ac41-2614c83b317f tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:45.005310 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b3922f08-b37f-45c3-ac41-2614c83b317f tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:45.005793 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b3922f08-b37f-45c3-ac41-2614c83b317f tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:45.006222 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b3922f08-b37f-45c3-ac41-2614c83b317f tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:45.006901 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b3922f08-b37f-45c3-ac41-2614c83b317f tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:45.007350 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b3922f08-b37f-45c3-ac41-2614c83b317f tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:45.007765 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b3922f08-b37f-45c3-ac41-2614c83b317f tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:45.011145 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:45.139606 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-b3922f08-b37f-45c3-ac41-2614c83b317f tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:45.148622 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-b3922f08-b37f-45c3-ac41-2614c83b317f tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1568 microversion: 2.1 time: 0.154657 Aug 31 19:19:45.149237 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 385/773] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:44 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:45.990822 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-5cd7b251-21b8-4545-b492-6dd2cdb0852f tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:45.991413 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-5cd7b251-21b8-4545-b492-6dd2cdb0852f tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] [instance: 5537ff84-8f70-4ba6-b219-09ffa1164d9a] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:45.997816 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5cd7b251-21b8-4545-b492-6dd2cdb0852f tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:45.998287 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5cd7b251-21b8-4545-b492-6dd2cdb0852f tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:45.998707 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5cd7b251-21b8-4545-b492-6dd2cdb0852f tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:45.999377 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5cd7b251-21b8-4545-b492-6dd2cdb0852f tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:45.999819 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5cd7b251-21b8-4545-b492-6dd2cdb0852f tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:46.000230 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5cd7b251-21b8-4545-b492-6dd2cdb0852f tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:46.143756 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-5cd7b251-21b8-4545-b492-6dd2cdb0852f tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07fb9a216ac4683852fc6cae7c10b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8ee0bdd09b45599a7c19798660aac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:46.152491 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-5cd7b251-21b8-4545-b492-6dd2cdb0852f tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] 10.222.0.65 "GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a" status: 200 len: 1752 microversion: 2.1 time: 0.165524 Aug 31 19:19:46.153051 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 389/774] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:45 2022] GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a => generated 1752 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:46.169854 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-2328032f-8c00-4282-b04e-80be14f2e93c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:46.170468 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-2328032f-8c00-4282-b04e-80be14f2e93c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:46.177003 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2328032f-8c00-4282-b04e-80be14f2e93c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:46.177521 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2328032f-8c00-4282-b04e-80be14f2e93c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:46.177958 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2328032f-8c00-4282-b04e-80be14f2e93c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:46.178644 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2328032f-8c00-4282-b04e-80be14f2e93c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:46.179098 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2328032f-8c00-4282-b04e-80be14f2e93c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:46.179521 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2328032f-8c00-4282-b04e-80be14f2e93c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:46.309106 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-2328032f-8c00-4282-b04e-80be14f2e93c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:46.316811 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-2328032f-8c00-4282-b04e-80be14f2e93c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1568 microversion: 2.1 time: 0.150780 Aug 31 19:19:46.317411 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 386/775] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:46 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:47.174286 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-3dafa7e6-4c77-4ed5-a51e-678993ec2b68 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:47.174913 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-3dafa7e6-4c77-4ed5-a51e-678993ec2b68 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] [instance: 5537ff84-8f70-4ba6-b219-09ffa1164d9a] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:47.180778 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3dafa7e6-4c77-4ed5-a51e-678993ec2b68 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:47.181281 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3dafa7e6-4c77-4ed5-a51e-678993ec2b68 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:47.181716 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3dafa7e6-4c77-4ed5-a51e-678993ec2b68 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:47.182397 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3dafa7e6-4c77-4ed5-a51e-678993ec2b68 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:47.182843 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3dafa7e6-4c77-4ed5-a51e-678993ec2b68 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:47.183258 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3dafa7e6-4c77-4ed5-a51e-678993ec2b68 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:47.323876 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-3dafa7e6-4c77-4ed5-a51e-678993ec2b68 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07fb9a216ac4683852fc6cae7c10b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8ee0bdd09b45599a7c19798660aac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:47.331939 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-3dafa7e6-4c77-4ed5-a51e-678993ec2b68 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] 10.222.0.65 "GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a" status: 200 len: 1752 microversion: 2.1 time: 0.161698 Aug 31 19:19:47.332503 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 390/776] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:47 2022] GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a => generated 1752 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:47.338026 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-512da659-80f9-4232-969e-89853789c678 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:47.339112 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-512da659-80f9-4232-969e-89853789c678 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:47.345379 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-512da659-80f9-4232-969e-89853789c678 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:47.345853 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-512da659-80f9-4232-969e-89853789c678 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:47.346275 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-512da659-80f9-4232-969e-89853789c678 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:47.346949 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-512da659-80f9-4232-969e-89853789c678 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:47.347392 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-512da659-80f9-4232-969e-89853789c678 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:47.347822 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-512da659-80f9-4232-969e-89853789c678 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:47.480677 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-512da659-80f9-4232-969e-89853789c678 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:47.488387 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-512da659-80f9-4232-969e-89853789c678 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1568 microversion: 2.1 time: 0.154072 Aug 31 19:19:47.488951 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 387/777] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:47 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:19:48.066781 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-2aa80dfd-3a3f-4dd1-b079-97c493c11aad tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:48.067262 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-2aa80dfd-3a3f-4dd1-b079-97c493c11aad tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: f7d66e43-86cd-49c9-9bf0-09489b7fd178] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:48.073725 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2aa80dfd-3a3f-4dd1-b079-97c493c11aad tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:48.074198 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2aa80dfd-3a3f-4dd1-b079-97c493c11aad tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:48.074614 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2aa80dfd-3a3f-4dd1-b079-97c493c11aad tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:48.075285 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2aa80dfd-3a3f-4dd1-b079-97c493c11aad tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:48.075723 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2aa80dfd-3a3f-4dd1-b079-97c493c11aad tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:48.076135 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2aa80dfd-3a3f-4dd1-b079-97c493c11aad tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:48.100441 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-2aa80dfd-3a3f-4dd1-b079-97c493c11aad tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178/ips" status: 200 len: 148 microversion: 2.1 time: 0.037522 Aug 31 19:19:48.100914 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 391/778] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Aug 31 19:19:48 2022] GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178/ips => generated 148 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:19:48.112506 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-985a5a15-ce77-4894-aa65-4e43874d618a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3515b79e-01e7-486c-aa74-2552b84a549d"}} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:19:48.114885 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-985a5a15-ce77-4894-aa65-4e43874d618a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: f7d66e43-86cd-49c9-9bf0-09489b7fd178] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:48.116695 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=40 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:48.122541 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-985a5a15-ce77-4894-aa65-4e43874d618a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:48.123018 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-985a5a15-ce77-4894-aa65-4e43874d618a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:48.123447 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-985a5a15-ce77-4894-aa65-4e43874d618a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:48.124137 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-985a5a15-ce77-4894-aa65-4e43874d618a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:48.124594 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-985a5a15-ce77-4894-aa65-4e43874d618a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:48.125014 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-985a5a15-ce77-4894-aa65-4e43874d618a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:48.202814 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.wsgi [None req-985a5a15-ce77-4894-aa65-4e43874d618a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] HTTP exception thrown: Invalid volume: volume 3515b79e-01e7-486c-aa74-2552b84a549d is already attached to instances: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb Aug 31 19:19:48.204564 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-985a5a15-ce77-4894-aa65-4e43874d618a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Request method failure captured: Aug 31 19:19:48.204564 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: request: POST /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178/os-volume_attachments HTTP/1.1 Aug 31 19:19:48.204564 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Accept: application/json Aug 31 19:19:48.204564 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Accept-Encoding: identity Aug 31 19:19:48.204564 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Connection: close Aug 31 19:19:48.204564 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Content-Length: 74 Aug 31 19:19:48.204564 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Content-Type: application/json Aug 31 19:19:48.204564 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Host: 10.222.0.65 Aug 31 19:19:48.204564 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Openstack-System-Scope: None Aug 31 19:19:48.204564 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: User-Agent: python-urllib3/1.26.12 Aug 31 19:19:48.204564 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Auth-Token: gAAAAABjD7KQFx_CTgljpc_qTbwt7yeZ02hQJcRRTGjLujiMjCCm-y4KZuXdAcd8yicyJshoDc3mgcG2dVFxaRyv0OYT2U8p5W3ZDfvXP2qQyvl9GhMqVycMoUFtordGBMOd64j9xBsCCsuy7lF-JjelfCeTLgdgY5owS10WSU3cjBe8ulEuuUA Aug 31 19:19:48.204564 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Domain-Id: None Aug 31 19:19:48.204564 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Domain-Name: None Aug 31 19:19:48.204564 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Identity-Status: Confirmed Aug 31 19:19:48.204564 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Is-Admin-Project: True Aug 31 19:19:48.204564 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Id: default Aug 31 19:19:48.204564 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Name: Default Aug 31 19:19:48.204564 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Id: e6d782400f1e432c8d10a31334c42e68 Aug 31 19:19:48.204564 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Name: tempest-AttachVolumeNegativeTest-739769459 Aug 31 19:19:48.204564 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Role: member,reader Aug 31 19:19:48.204564 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Roles: member,reader Aug 31 19:19:48.206231 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/e6d782400f1e432c8d10a31334c42e68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e6d782400f1e432c8d10a31334c42e68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_e6d782400f1e432c8d10a31334c42e68", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e6d782400f1e432c8d10a31334c42e68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:19:48.206231 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant: tempest-AttachVolumeNegativeTest-739769459 Aug 31 19:19:48.206231 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant-Id: e6d782400f1e432c8d10a31334c42e68 Aug 31 19:19:48.206231 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-739769459 Aug 31 19:19:48.206231 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User: tempest-AttachVolumeNegativeTest-739769459-project Aug 31 19:19:48.206231 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Id: default Aug 31 19:19:48.206231 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Name: Default Aug 31 19:19:48.206231 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Id: 0bfa1533b0944bd681f4c2a33cf701b0 Aug 31 19:19:48.206231 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Name: tempest-AttachVolumeNegativeTest-739769459-project Aug 31 19:19:48.206231 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Aug 31 19:19:48.206231 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: {"volumeAttachment": {"volumeId": "3515b79e-01e7-486c-aa74-2552b84a549d"}} Aug 31 19:19:48.206231 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: method: > Aug 31 19:19:48.207132 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: exception: Invalid volume: volume 3515b79e-01e7-486c-aa74-2552b84a549d is already attached to instances: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb Aug 31 19:19:48.207132 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: action_args: {'server_id': 'f7d66e43-86cd-49c9-9bf0-09489b7fd178', 'body': {'volumeAttachment': {'volumeId': '3515b79e-01e7-486c-aa74-2552b84a549d'}}} Aug 31 19:19:48.207132 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:19:48.207132 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:19:48.207132 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 19:19:48.207132 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 19:19:48.207132 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 19:19:48.207132 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 19:19:48.207132 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 19:19:48.207132 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 19:19:48.207132 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 31 19:19:48.207132 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 31 19:19:48.207132 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 31 19:19:48.207132 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 31 19:19:48.207132 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 3515b79e-01e7-486c-aa74-2552b84a549d is already attached to instances: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb Aug 31 19:19:48.207132 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:19:48.207132 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:19:48.207132 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:19:48.207132 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:19:48.208566 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:19:48.208566 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:19:48.208566 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:19:48.208566 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:19:48.208566 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:19:48.208566 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:19:48.208566 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 19:19:48.208566 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 19:19:48.208566 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 19:19:48.208566 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 19:19:48.208566 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 19:19:48.208566 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 19:19:48.208566 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 31 19:19:48.208566 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 19:19:48.208566 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 3515b79e-01e7-486c-aa74-2552b84a549d is already attached to instances: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb Aug 31 19:19:48.208566 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:19:48.208566 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:19:48.208566 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:19:48.208566 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:19:48.208566 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:19:48.210105 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:19:48.210105 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:19:48.210105 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:19:48.210105 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 3515b79e-01e7-486c-aa74-2552b84a549d is already attached to instances: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb Aug 31 19:19:48.210105 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:19:48.210105 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-985a5a15-ce77-4894-aa65-4e43874d618a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Returning 400 to user: Invalid volume: volume 3515b79e-01e7-486c-aa74-2552b84a549d is already attached to instances: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb {{(pid=120623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:19:48.210105 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-985a5a15-ce77-4894-aa65-4e43874d618a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "POST /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097477 Aug 31 19:19:48.210105 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 388/779] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 31 19:19:48 2022] POST /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 19:19:48.217074 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-02b807e0-12f2-4bf2-a779-1a700dee9232 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:48.217614 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-02b807e0-12f2-4bf2-a779-1a700dee9232 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: f7d66e43-86cd-49c9-9bf0-09489b7fd178] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:48.223895 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-02b807e0-12f2-4bf2-a779-1a700dee9232 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:48.224364 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-02b807e0-12f2-4bf2-a779-1a700dee9232 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:48.225047 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-02b807e0-12f2-4bf2-a779-1a700dee9232 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:48.225752 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-02b807e0-12f2-4bf2-a779-1a700dee9232 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:48.226199 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-02b807e0-12f2-4bf2-a779-1a700dee9232 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:48.226610 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-02b807e0-12f2-4bf2-a779-1a700dee9232 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:48.251812 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-02b807e0-12f2-4bf2-a779-1a700dee9232 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: f7d66e43-86cd-49c9-9bf0-09489b7fd178] Going to try to terminate instance {{(pid=120624) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 19:19:48.323616 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-02b807e0-12f2-4bf2-a779-1a700dee9232 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "DELETE /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178" status: 204 len: 0 microversion: 2.1 time: 0.110054 Aug 31 19:19:48.324196 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 392/780] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 31 19:19:48 2022] DELETE /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 19:19:48.332623 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d604e095-c8de-49ec-8dbe-f1c5d092e7ab tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:48.333264 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d604e095-c8de-49ec-8dbe-f1c5d092e7ab tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: f7d66e43-86cd-49c9-9bf0-09489b7fd178] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:48.339932 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d604e095-c8de-49ec-8dbe-f1c5d092e7ab tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:48.340544 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d604e095-c8de-49ec-8dbe-f1c5d092e7ab tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:48.340824 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d604e095-c8de-49ec-8dbe-f1c5d092e7ab tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:48.341535 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d604e095-c8de-49ec-8dbe-f1c5d092e7ab tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:48.341975 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d604e095-c8de-49ec-8dbe-f1c5d092e7ab tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:48.342463 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d604e095-c8de-49ec-8dbe-f1c5d092e7ab tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:48.354741 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-9a619795-7422-4672-bda1-eff3a0375ae4 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:48.355368 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-9a619795-7422-4672-bda1-eff3a0375ae4 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] [instance: 5537ff84-8f70-4ba6-b219-09ffa1164d9a] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:48.361493 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9a619795-7422-4672-bda1-eff3a0375ae4 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:48.361979 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9a619795-7422-4672-bda1-eff3a0375ae4 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:48.362407 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9a619795-7422-4672-bda1-eff3a0375ae4 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:48.363095 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9a619795-7422-4672-bda1-eff3a0375ae4 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:48.363539 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9a619795-7422-4672-bda1-eff3a0375ae4 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:48.363957 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9a619795-7422-4672-bda1-eff3a0375ae4 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:48.471991 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-d604e095-c8de-49ec-8dbe-f1c5d092e7ab tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:48.480838 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-d604e095-c8de-49ec-8dbe-f1c5d092e7ab tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178" status: 200 len: 1681 microversion: 2.1 time: 0.152202 Aug 31 19:19:48.481637 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 389/781] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:48 2022] GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:19:48.506779 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-9a619795-7422-4672-bda1-eff3a0375ae4 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07fb9a216ac4683852fc6cae7c10b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8ee0bdd09b45599a7c19798660aac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:48.509398 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-b8893177-226f-46af-b24f-e8b2c0cace15 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:48.510014 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-b8893177-226f-46af-b24f-e8b2c0cace15 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:48.515017 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-9a619795-7422-4672-bda1-eff3a0375ae4 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] 10.222.0.65 "GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a" status: 200 len: 1752 microversion: 2.1 time: 0.165312 Aug 31 19:19:48.515569 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 393/782] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:48 2022] GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a => generated 1752 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:19:48.516151 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b8893177-226f-46af-b24f-e8b2c0cace15 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:48.516726 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b8893177-226f-46af-b24f-e8b2c0cace15 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:48.517171 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b8893177-226f-46af-b24f-e8b2c0cace15 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:48.517884 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b8893177-226f-46af-b24f-e8b2c0cace15 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:48.518345 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b8893177-226f-46af-b24f-e8b2c0cace15 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:48.518768 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b8893177-226f-46af-b24f-e8b2c0cace15 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:48.881801 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-b8893177-226f-46af-b24f-e8b2c0cace15 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:48.890050 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-b8893177-226f-46af-b24f-e8b2c0cace15 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1568 microversion: 2.1 time: 0.384514 Aug 31 19:19:48.890675 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 390/783] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:48 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1568 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:49.501966 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-1982be49-23aa-4ed9-9afa-145bfe61a721 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:49.502578 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-1982be49-23aa-4ed9-9afa-145bfe61a721 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: f7d66e43-86cd-49c9-9bf0-09489b7fd178] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:49.509027 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1982be49-23aa-4ed9-9afa-145bfe61a721 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:49.509536 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1982be49-23aa-4ed9-9afa-145bfe61a721 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:49.509969 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1982be49-23aa-4ed9-9afa-145bfe61a721 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:49.511257 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1982be49-23aa-4ed9-9afa-145bfe61a721 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:49.511707 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1982be49-23aa-4ed9-9afa-145bfe61a721 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:49.512124 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1982be49-23aa-4ed9-9afa-145bfe61a721 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:49.535735 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-067ee6ec-2179-4b14-852e-b4cd0a8ab1e8 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:49.536352 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-067ee6ec-2179-4b14-852e-b4cd0a8ab1e8 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] [instance: 5537ff84-8f70-4ba6-b219-09ffa1164d9a] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:49.542951 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-067ee6ec-2179-4b14-852e-b4cd0a8ab1e8 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:49.543442 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-067ee6ec-2179-4b14-852e-b4cd0a8ab1e8 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:49.543880 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-067ee6ec-2179-4b14-852e-b4cd0a8ab1e8 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:49.544575 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-067ee6ec-2179-4b14-852e-b4cd0a8ab1e8 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:49.545029 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-067ee6ec-2179-4b14-852e-b4cd0a8ab1e8 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:49.545478 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-067ee6ec-2179-4b14-852e-b4cd0a8ab1e8 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:49.643776 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-1982be49-23aa-4ed9-9afa-145bfe61a721 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:49.651676 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-1982be49-23aa-4ed9-9afa-145bfe61a721 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178" status: 200 len: 1681 microversion: 2.1 time: 0.153612 Aug 31 19:19:49.652259 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 394/784] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:49 2022] GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:49.687823 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-067ee6ec-2179-4b14-852e-b4cd0a8ab1e8 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07fb9a216ac4683852fc6cae7c10b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8ee0bdd09b45599a7c19798660aac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:49.695909 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-067ee6ec-2179-4b14-852e-b4cd0a8ab1e8 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] 10.222.0.65 "GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a" status: 200 len: 1752 microversion: 2.1 time: 0.163952 Aug 31 19:19:49.696472 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 391/785] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:49 2022] GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:19:49.911124 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-27702983-26d5-428d-ae00-d9d3dcd5bce3 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:49.911650 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-27702983-26d5-428d-ae00-d9d3dcd5bce3 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:49.918118 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-27702983-26d5-428d-ae00-d9d3dcd5bce3 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:49.918599 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-27702983-26d5-428d-ae00-d9d3dcd5bce3 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:49.919032 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-27702983-26d5-428d-ae00-d9d3dcd5bce3 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:49.919716 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-27702983-26d5-428d-ae00-d9d3dcd5bce3 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:49.920168 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-27702983-26d5-428d-ae00-d9d3dcd5bce3 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:49.920584 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-27702983-26d5-428d-ae00-d9d3dcd5bce3 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:50.048690 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-27702983-26d5-428d-ae00-d9d3dcd5bce3 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:50.056557 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-27702983-26d5-428d-ae00-d9d3dcd5bce3 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1568 microversion: 2.1 time: 0.149381 Aug 31 19:19:50.057129 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 395/786] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:49 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:50.675576 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-754c8767-6515-4cc5-99a4-53ec249676f4 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:50.676203 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-754c8767-6515-4cc5-99a4-53ec249676f4 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: f7d66e43-86cd-49c9-9bf0-09489b7fd178] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:50.682973 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-754c8767-6515-4cc5-99a4-53ec249676f4 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:50.683456 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-754c8767-6515-4cc5-99a4-53ec249676f4 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:50.683894 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-754c8767-6515-4cc5-99a4-53ec249676f4 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:50.684610 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-754c8767-6515-4cc5-99a4-53ec249676f4 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:50.685069 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-754c8767-6515-4cc5-99a4-53ec249676f4 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:50.685519 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-754c8767-6515-4cc5-99a4-53ec249676f4 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:50.719240 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-b6f02f7c-ca0b-4ae3-9e87-e4a2ff3317cd tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:50.720458 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-b6f02f7c-ca0b-4ae3-9e87-e4a2ff3317cd tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] [instance: 5537ff84-8f70-4ba6-b219-09ffa1164d9a] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:50.727299 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b6f02f7c-ca0b-4ae3-9e87-e4a2ff3317cd tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:50.727787 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b6f02f7c-ca0b-4ae3-9e87-e4a2ff3317cd tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:50.728220 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b6f02f7c-ca0b-4ae3-9e87-e4a2ff3317cd tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:50.728914 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b6f02f7c-ca0b-4ae3-9e87-e4a2ff3317cd tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:50.729413 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b6f02f7c-ca0b-4ae3-9e87-e4a2ff3317cd tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:50.729836 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b6f02f7c-ca0b-4ae3-9e87-e4a2ff3317cd tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:50.734427 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:50.879517 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-b6f02f7c-ca0b-4ae3-9e87-e4a2ff3317cd tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07fb9a216ac4683852fc6cae7c10b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8ee0bdd09b45599a7c19798660aac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:50.888387 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-b6f02f7c-ca0b-4ae3-9e87-e4a2ff3317cd tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] 10.222.0.65 "GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a" status: 200 len: 1752 microversion: 2.1 time: 0.174931 Aug 31 19:19:50.888947 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 396/787] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:50 2022] GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a => generated 1752 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:19:51.058702 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-754c8767-6515-4cc5-99a4-53ec249676f4 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:51.066482 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-754c8767-6515-4cc5-99a4-53ec249676f4 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178" status: 200 len: 1681 microversion: 2.1 time: 0.396362 Aug 31 19:19:51.067061 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 392/788] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:50 2022] GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178 => generated 1681 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:51.077971 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-4ea4afbd-409b-4b07-a98b-0485e4bbfa86 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:51.078644 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-4ea4afbd-409b-4b07-a98b-0485e4bbfa86 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:51.084541 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4ea4afbd-409b-4b07-a98b-0485e4bbfa86 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:51.085024 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4ea4afbd-409b-4b07-a98b-0485e4bbfa86 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:51.085482 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4ea4afbd-409b-4b07-a98b-0485e4bbfa86 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:51.086168 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4ea4afbd-409b-4b07-a98b-0485e4bbfa86 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:51.086617 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4ea4afbd-409b-4b07-a98b-0485e4bbfa86 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:51.087033 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4ea4afbd-409b-4b07-a98b-0485e4bbfa86 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:51.223035 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-4ea4afbd-409b-4b07-a98b-0485e4bbfa86 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:51.231575 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-4ea4afbd-409b-4b07-a98b-0485e4bbfa86 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1568 microversion: 2.1 time: 0.158071 Aug 31 19:19:51.232143 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 397/789] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:51 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:51.706495 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-2bea3ab4-4a95-4f3f-829d-e5f61e79d69b req-57285a9d-65fe-40cc-90fa-f7206bf34cee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7d66e43-86cd-49c9-9bf0-09489b7fd178", "name": "network-vif-deleted", "tag": "29dfcfdc-0475-40e4-a4ec-d26e3026aa4a"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:19:51.717212 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-2bea3ab4-4a95-4f3f-829d-e5f61e79d69b req-57285a9d-65fe-40cc-90fa-f7206bf34cee service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:51.717714 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-2bea3ab4-4a95-4f3f-829d-e5f61e79d69b req-57285a9d-65fe-40cc-90fa-f7206bf34cee service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:51.718155 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-2bea3ab4-4a95-4f3f-829d-e5f61e79d69b req-57285a9d-65fe-40cc-90fa-f7206bf34cee service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:51.729577 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-2bea3ab4-4a95-4f3f-829d-e5f61e79d69b req-57285a9d-65fe-40cc-90fa-f7206bf34cee service nova] Creating event network-vif-deleted:29dfcfdc-0475-40e4-a4ec-d26e3026aa4a for instance f7d66e43-86cd-49c9-9bf0-09489b7fd178 on hv-cinder-83538 Aug 31 19:19:51.735160 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-2bea3ab4-4a95-4f3f-829d-e5f61e79d69b req-57285a9d-65fe-40cc-90fa-f7206bf34cee service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032319 Aug 31 19:19:51.736083 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 393/790] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:19:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:19:51.909596 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-78e24249-89c1-450e-a970-e2fa581e90be tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:51.910207 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-78e24249-89c1-450e-a970-e2fa581e90be tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] [instance: 5537ff84-8f70-4ba6-b219-09ffa1164d9a] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:51.916565 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-78e24249-89c1-450e-a970-e2fa581e90be tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:51.917123 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-78e24249-89c1-450e-a970-e2fa581e90be tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:51.917760 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-78e24249-89c1-450e-a970-e2fa581e90be tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:51.918674 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-78e24249-89c1-450e-a970-e2fa581e90be tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:51.919113 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-78e24249-89c1-450e-a970-e2fa581e90be tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:51.919535 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-78e24249-89c1-450e-a970-e2fa581e90be tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:52.067220 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-78e24249-89c1-450e-a970-e2fa581e90be tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07fb9a216ac4683852fc6cae7c10b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8ee0bdd09b45599a7c19798660aac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:52.076094 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-78e24249-89c1-450e-a970-e2fa581e90be tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] 10.222.0.65 "GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a" status: 200 len: 1752 microversion: 2.1 time: 0.170346 Aug 31 19:19:52.076664 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 398/791] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:51 2022] GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a => generated 1752 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:52.095155 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-6e47fbbf-1005-4b5e-a167-1616a89c9f88 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:52.096020 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-6e47fbbf-1005-4b5e-a167-1616a89c9f88 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: f7d66e43-86cd-49c9-9bf0-09489b7fd178] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:52.102790 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6e47fbbf-1005-4b5e-a167-1616a89c9f88 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:52.103267 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6e47fbbf-1005-4b5e-a167-1616a89c9f88 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:52.103697 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6e47fbbf-1005-4b5e-a167-1616a89c9f88 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:52.104379 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6e47fbbf-1005-4b5e-a167-1616a89c9f88 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:52.104819 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6e47fbbf-1005-4b5e-a167-1616a89c9f88 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:52.105244 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6e47fbbf-1005-4b5e-a167-1616a89c9f88 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:52.171958 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-6e47fbbf-1005-4b5e-a167-1616a89c9f88 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:52.180098 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-6e47fbbf-1005-4b5e-a167-1616a89c9f88 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178" status: 200 len: 1613 microversion: 2.1 time: 0.089179 Aug 31 19:19:52.180924 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 394/792] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:52 2022] GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178 => generated 1613 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:52.253949 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-a04721d4-deca-4c2b-8059-5f182f1da05a tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:52.254700 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-a04721d4-deca-4c2b-8059-5f182f1da05a tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:52.261832 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a04721d4-deca-4c2b-8059-5f182f1da05a tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:52.262599 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a04721d4-deca-4c2b-8059-5f182f1da05a tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:52.263031 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a04721d4-deca-4c2b-8059-5f182f1da05a tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:52.263756 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a04721d4-deca-4c2b-8059-5f182f1da05a tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:52.264208 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a04721d4-deca-4c2b-8059-5f182f1da05a tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:52.264752 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a04721d4-deca-4c2b-8059-5f182f1da05a tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:52.402981 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-a04721d4-deca-4c2b-8059-5f182f1da05a tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:52.411279 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-a04721d4-deca-4c2b-8059-5f182f1da05a tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1568 microversion: 2.1 time: 0.161407 Aug 31 19:19:52.412095 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 399/793] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:52 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:53.098062 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-a5df16c8-b613-4322-8843-dabd775301fc tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:53.098662 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-a5df16c8-b613-4322-8843-dabd775301fc tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] [instance: 5537ff84-8f70-4ba6-b219-09ffa1164d9a] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:53.105818 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a5df16c8-b613-4322-8843-dabd775301fc tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:53.106312 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a5df16c8-b613-4322-8843-dabd775301fc tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:53.106746 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a5df16c8-b613-4322-8843-dabd775301fc tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:53.107486 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a5df16c8-b613-4322-8843-dabd775301fc tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:53.107966 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a5df16c8-b613-4322-8843-dabd775301fc tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:53.108392 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a5df16c8-b613-4322-8843-dabd775301fc tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:53.202117 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-86fa7182-8b2c-4a9a-a179-fba49d57850a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:53.202848 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-86fa7182-8b2c-4a9a-a179-fba49d57850a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: f7d66e43-86cd-49c9-9bf0-09489b7fd178] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:53.209569 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-86fa7182-8b2c-4a9a-a179-fba49d57850a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:53.210052 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-86fa7182-8b2c-4a9a-a179-fba49d57850a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:53.210678 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-86fa7182-8b2c-4a9a-a179-fba49d57850a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:53.211550 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-86fa7182-8b2c-4a9a-a179-fba49d57850a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:53.212173 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-86fa7182-8b2c-4a9a-a179-fba49d57850a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:53.212595 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-86fa7182-8b2c-4a9a-a179-fba49d57850a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:53.282828 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-86fa7182-8b2c-4a9a-a179-fba49d57850a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:53.285938 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-a5df16c8-b613-4322-8843-dabd775301fc tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07fb9a216ac4683852fc6cae7c10b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8ee0bdd09b45599a7c19798660aac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:53.292238 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-86fa7182-8b2c-4a9a-a179-fba49d57850a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178" status: 200 len: 1327 microversion: 2.1 time: 0.094465 Aug 31 19:19:53.292819 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 400/794] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:53 2022] GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178 => generated 1327 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:19:53.295698 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-a5df16c8-b613-4322-8843-dabd775301fc tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] 10.222.0.65 "GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a" status: 200 len: 1752 microversion: 2.1 time: 0.201530 Aug 31 19:19:53.296261 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 395/795] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:53 2022] GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a => generated 1752 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:53.431895 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-909bd059-9a9b-4b58-9323-e8707576ae9c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:53.433112 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-909bd059-9a9b-4b58-9323-e8707576ae9c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:53.438930 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-909bd059-9a9b-4b58-9323-e8707576ae9c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:53.439418 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-909bd059-9a9b-4b58-9323-e8707576ae9c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:53.439849 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-909bd059-9a9b-4b58-9323-e8707576ae9c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:53.440537 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-909bd059-9a9b-4b58-9323-e8707576ae9c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:53.440988 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-909bd059-9a9b-4b58-9323-e8707576ae9c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:53.441437 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-909bd059-9a9b-4b58-9323-e8707576ae9c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:53.818281 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-909bd059-9a9b-4b58-9323-e8707576ae9c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:53.825954 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-909bd059-9a9b-4b58-9323-e8707576ae9c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1568 microversion: 2.1 time: 0.397941 Aug 31 19:19:53.826511 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 401/796] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:53 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1568 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:54.311799 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-3b8ca88a-a5f4-4b6d-b53d-e940a2f7ff28 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:54.312735 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-3b8ca88a-a5f4-4b6d-b53d-e940a2f7ff28 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: f7d66e43-86cd-49c9-9bf0-09489b7fd178] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:54.316949 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-fd8e3f51-5e8a-45f3-a63a-82d2424a3d95 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:54.317628 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-fd8e3f51-5e8a-45f3-a63a-82d2424a3d95 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] [instance: 5537ff84-8f70-4ba6-b219-09ffa1164d9a] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:54.319269 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3b8ca88a-a5f4-4b6d-b53d-e940a2f7ff28 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:54.319749 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3b8ca88a-a5f4-4b6d-b53d-e940a2f7ff28 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:54.320174 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3b8ca88a-a5f4-4b6d-b53d-e940a2f7ff28 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:54.320864 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3b8ca88a-a5f4-4b6d-b53d-e940a2f7ff28 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:54.321346 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3b8ca88a-a5f4-4b6d-b53d-e940a2f7ff28 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:54.321764 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3b8ca88a-a5f4-4b6d-b53d-e940a2f7ff28 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:54.324477 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fd8e3f51-5e8a-45f3-a63a-82d2424a3d95 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:54.324961 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fd8e3f51-5e8a-45f3-a63a-82d2424a3d95 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:54.325424 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fd8e3f51-5e8a-45f3-a63a-82d2424a3d95 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:54.326127 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fd8e3f51-5e8a-45f3-a63a-82d2424a3d95 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:54.326582 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fd8e3f51-5e8a-45f3-a63a-82d2424a3d95 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:54.327005 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fd8e3f51-5e8a-45f3-a63a-82d2424a3d95 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:54.354996 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3b8ca88a-a5f4-4b6d-b53d-e940a2f7ff28 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:54.355478 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3b8ca88a-a5f4-4b6d-b53d-e940a2f7ff28 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:54.355910 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3b8ca88a-a5f4-4b6d-b53d-e940a2f7ff28 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:54.356502 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.objects.instance [None req-3b8ca88a-a5f4-4b6d-b53d-e940a2f7ff28 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lazy-loading 'fault' on Instance uuid f7d66e43-86cd-49c9-9bf0-09489b7fd178 {{(pid=120623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:19:54.399465 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-3b8ca88a-a5f4-4b6d-b53d-e940a2f7ff28 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:54.408555 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-3b8ca88a-a5f4-4b6d-b53d-e940a2f7ff28 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178" status: 200 len: 1332 microversion: 2.1 time: 0.100204 Aug 31 19:19:54.410660 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 396/797] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:54 2022] GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178 => generated 1332 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:54.490810 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-fd8e3f51-5e8a-45f3-a63a-82d2424a3d95 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07fb9a216ac4683852fc6cae7c10b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8ee0bdd09b45599a7c19798660aac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:54.491972 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-6ffe3c6a-ab66-4c59-b7ad-c37fd8fd7879 req-68d02556-6e2b-460d-abbe-fefa941cb00d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52d843ca-5f08-47f6-98dc-2df1d30438cc", "name": "network-vif-unplugged", "status": "completed", "tag": "4fdbfd0c-e43a-4c2c-ab61-0f67e2dfee09"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:19:54.499718 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-fd8e3f51-5e8a-45f3-a63a-82d2424a3d95 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] 10.222.0.65 "GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a" status: 200 len: 1755 microversion: 2.1 time: 0.186467 Aug 31 19:19:54.500313 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 402/798] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:54 2022] GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a => generated 1755 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:19:54.507586 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-6ffe3c6a-ab66-4c59-b7ad-c37fd8fd7879 req-68d02556-6e2b-460d-abbe-fefa941cb00d service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:54.508146 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-6ffe3c6a-ab66-4c59-b7ad-c37fd8fd7879 req-68d02556-6e2b-460d-abbe-fefa941cb00d service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:54.508648 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-6ffe3c6a-ab66-4c59-b7ad-c37fd8fd7879 req-68d02556-6e2b-460d-abbe-fefa941cb00d service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:54.520676 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-6ffe3c6a-ab66-4c59-b7ad-c37fd8fd7879 req-68d02556-6e2b-460d-abbe-fefa941cb00d service nova] Creating event network-vif-unplugged:4fdbfd0c-e43a-4c2c-ab61-0f67e2dfee09 for instance 52d843ca-5f08-47f6-98dc-2df1d30438cc on hv-cinder-83538 Aug 31 19:19:54.525646 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-6ffe3c6a-ab66-4c59-b7ad-c37fd8fd7879 req-68d02556-6e2b-460d-abbe-fefa941cb00d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038213 Aug 31 19:19:54.526301 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 397/799] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:19:54.847320 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-ffc0d825-1981-441a-a4ad-4b9fa4e42ae3 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:54.847924 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-ffc0d825-1981-441a-a4ad-4b9fa4e42ae3 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:54.854147 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ffc0d825-1981-441a-a4ad-4b9fa4e42ae3 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:54.854652 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ffc0d825-1981-441a-a4ad-4b9fa4e42ae3 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:54.855082 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ffc0d825-1981-441a-a4ad-4b9fa4e42ae3 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:54.855765 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ffc0d825-1981-441a-a4ad-4b9fa4e42ae3 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:54.856211 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ffc0d825-1981-441a-a4ad-4b9fa4e42ae3 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:54.856627 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ffc0d825-1981-441a-a4ad-4b9fa4e42ae3 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:54.999965 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-ffc0d825-1981-441a-a4ad-4b9fa4e42ae3 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:55.008153 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-ffc0d825-1981-441a-a4ad-4b9fa4e42ae3 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1569 microversion: 2.1 time: 0.164628 Aug 31 19:19:55.008856 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 403/800] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:54 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:19:55.030019 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e9949ac7-37a5-4374-8ac5-e78479f4214d tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:19:55.030737 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-e9949ac7-37a5-4374-8ac5-e78479f4214d tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:55.036848 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e9949ac7-37a5-4374-8ac5-e78479f4214d tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:55.037380 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e9949ac7-37a5-4374-8ac5-e78479f4214d tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:55.037819 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e9949ac7-37a5-4374-8ac5-e78479f4214d tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:55.038503 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e9949ac7-37a5-4374-8ac5-e78479f4214d tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:55.038959 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e9949ac7-37a5-4374-8ac5-e78479f4214d tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:55.039384 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e9949ac7-37a5-4374-8ac5-e78479f4214d tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:55.172385 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-e9949ac7-37a5-4374-8ac5-e78479f4214d tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120623) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 19:19:55.238758 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-e9949ac7-37a5-4374-8ac5-e78479f4214d tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "POST /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc/action" status: 202 len: 0 microversion: 2.1 time: 0.213399 Aug 31 19:19:55.239286 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 398/801] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 31 19:19:55 2022] POST /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:19:55.248406 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-8b0cdad7-31b1-4001-b399-f630b4a41d57 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:55.249600 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-8b0cdad7-31b1-4001-b399-f630b4a41d57 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:55.255319 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8b0cdad7-31b1-4001-b399-f630b4a41d57 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:55.256010 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8b0cdad7-31b1-4001-b399-f630b4a41d57 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:55.256444 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8b0cdad7-31b1-4001-b399-f630b4a41d57 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:55.257141 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8b0cdad7-31b1-4001-b399-f630b4a41d57 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:55.258397 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8b0cdad7-31b1-4001-b399-f630b4a41d57 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:55.258830 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8b0cdad7-31b1-4001-b399-f630b4a41d57 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:55.402589 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-8b0cdad7-31b1-4001-b399-f630b4a41d57 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:55.410365 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-8b0cdad7-31b1-4001-b399-f630b4a41d57 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1577 microversion: 2.1 time: 0.166892 Aug 31 19:19:55.410945 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 404/802] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:55 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1577 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:55.429782 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-08bd6050-38d8-4759-9ce9-5e2d9590121c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:55.430484 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-08bd6050-38d8-4759-9ce9-5e2d9590121c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: f7d66e43-86cd-49c9-9bf0-09489b7fd178] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:55.438804 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-08bd6050-38d8-4759-9ce9-5e2d9590121c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:55.439367 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-08bd6050-38d8-4759-9ce9-5e2d9590121c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:55.439865 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-08bd6050-38d8-4759-9ce9-5e2d9590121c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:55.440625 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-08bd6050-38d8-4759-9ce9-5e2d9590121c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:55.441219 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-08bd6050-38d8-4759-9ce9-5e2d9590121c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:55.441712 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-08bd6050-38d8-4759-9ce9-5e2d9590121c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:55.455696 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.wsgi [None req-08bd6050-38d8-4759-9ce9-5e2d9590121c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] HTTP exception thrown: Instance f7d66e43-86cd-49c9-9bf0-09489b7fd178 could not be found. Aug 31 19:19:55.457431 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-08bd6050-38d8-4759-9ce9-5e2d9590121c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Request method failure captured: Aug 31 19:19:55.457431 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: request: GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178 HTTP/1.1 Aug 31 19:19:55.457431 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Accept: application/json Aug 31 19:19:55.457431 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Accept-Encoding: identity Aug 31 19:19:55.457431 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Connection: close Aug 31 19:19:55.457431 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Content-Length: 0 Aug 31 19:19:55.457431 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Content-Type: application/json Aug 31 19:19:55.457431 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Host: 10.222.0.65 Aug 31 19:19:55.457431 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Openstack-System-Scope: None Aug 31 19:19:55.457431 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: User-Agent: python-urllib3/1.26.12 Aug 31 19:19:55.457431 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Auth-Token: gAAAAABjD7KQFx_CTgljpc_qTbwt7yeZ02hQJcRRTGjLujiMjCCm-y4KZuXdAcd8yicyJshoDc3mgcG2dVFxaRyv0OYT2U8p5W3ZDfvXP2qQyvl9GhMqVycMoUFtordGBMOd64j9xBsCCsuy7lF-JjelfCeTLgdgY5owS10WSU3cjBe8ulEuuUA Aug 31 19:19:55.457431 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Domain-Id: None Aug 31 19:19:55.457431 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Domain-Name: None Aug 31 19:19:55.457431 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Identity-Status: Confirmed Aug 31 19:19:55.457431 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Is-Admin-Project: True Aug 31 19:19:55.457431 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Id: default Aug 31 19:19:55.457431 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Name: Default Aug 31 19:19:55.457431 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Id: e6d782400f1e432c8d10a31334c42e68 Aug 31 19:19:55.457431 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Name: tempest-AttachVolumeNegativeTest-739769459 Aug 31 19:19:55.457431 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Role: member,reader Aug 31 19:19:55.457431 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Roles: member,reader Aug 31 19:19:55.459136 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/e6d782400f1e432c8d10a31334c42e68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e6d782400f1e432c8d10a31334c42e68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_e6d782400f1e432c8d10a31334c42e68", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e6d782400f1e432c8d10a31334c42e68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:19:55.459136 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant: tempest-AttachVolumeNegativeTest-739769459 Aug 31 19:19:55.459136 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant-Id: e6d782400f1e432c8d10a31334c42e68 Aug 31 19:19:55.459136 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-739769459 Aug 31 19:19:55.459136 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User: tempest-AttachVolumeNegativeTest-739769459-project Aug 31 19:19:55.459136 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Id: default Aug 31 19:19:55.459136 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Name: Default Aug 31 19:19:55.459136 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Id: 0bfa1533b0944bd681f4c2a33cf701b0 Aug 31 19:19:55.459136 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Name: tempest-AttachVolumeNegativeTest-739769459-project Aug 31 19:19:55.459136 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: method: > Aug 31 19:19:55.459136 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: exception: Instance f7d66e43-86cd-49c9-9bf0-09489b7fd178 could not be found. Aug 31 19:19:55.459136 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: action_args: {'id': 'f7d66e43-86cd-49c9-9bf0-09489b7fd178'} Aug 31 19:19:55.460037 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:19:55.460037 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:19:55.460037 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:19:55.460037 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:19:55.460037 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:19:55.460037 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:19:55.460037 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:19:55.460037 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:19:55.460037 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:19:55.460037 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:19:55.460037 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7d66e43-86cd-49c9-9bf0-09489b7fd178 could not be found. Aug 31 19:19:55.460037 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:19:55.460037 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:19:55.460037 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:19:55.460037 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:19:55.460037 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:19:55.460037 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:19:55.460037 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:19:55.460037 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:19:55.460037 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:19:55.461382 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:19:55.461382 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:19:55.461382 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:19:55.461382 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:19:55.461382 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:19:55.461382 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:19:55.461382 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:19:55.461382 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7d66e43-86cd-49c9-9bf0-09489b7fd178 could not be found. Aug 31 19:19:55.461382 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:19:55.461382 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:19:55.461382 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:19:55.461382 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:19:55.461382 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:19:55.461382 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:19:55.461382 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:19:55.461382 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:19:55.461382 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7d66e43-86cd-49c9-9bf0-09489b7fd178 could not be found. Aug 31 19:19:55.461382 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:19:55.462544 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-08bd6050-38d8-4759-9ce9-5e2d9590121c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Returning 404 to user: Instance f7d66e43-86cd-49c9-9bf0-09489b7fd178 could not be found. {{(pid=120623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:19:55.462544 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-08bd6050-38d8-4759-9ce9-5e2d9590121c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178" status: 404 len: 111 microversion: 2.1 time: 0.033879 Aug 31 19:19:55.462544 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 399/803] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:55 2022] GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:19:55.469039 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-56fb026a-9181-436d-af4a-d2a6d54234f1 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '.version_select at 0x7fdb89c4e9d0>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:55.489751 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-56fb026a-9181-436d-af4a-d2a6d54234f1 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1345825998" status: 202 len: 0 microversion: 2.1 time: 0.024587 Aug 31 19:19:55.490259 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 405/804] 10.222.0.65 () {58 vars in 1221 bytes} [Wed Aug 31 19:19:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1345825998 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:19:56.155803 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-f91bb34f-976b-4a26-bae1-499570254f3c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:56.156298 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-f91bb34f-976b-4a26-bae1-499570254f3c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:56.162189 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f91bb34f-976b-4a26-bae1-499570254f3c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:56.162675 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f91bb34f-976b-4a26-bae1-499570254f3c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:56.163108 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f91bb34f-976b-4a26-bae1-499570254f3c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:56.163805 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f91bb34f-976b-4a26-bae1-499570254f3c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:56.164259 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f91bb34f-976b-4a26-bae1-499570254f3c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:56.164684 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f91bb34f-976b-4a26-bae1-499570254f3c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:56.249541 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.objects.instance [None req-f91bb34f-976b-4a26-bae1-499570254f3c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lazy-loading 'services' on Instance uuid e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb {{(pid=120623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:19:56.320206 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-f91bb34f-976b-4a26-bae1-499570254f3c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "DELETE /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb/os-volume_attachments/3515b79e-01e7-486c-aa74-2552b84a549d" status: 202 len: 0 microversion: 2.1 time: 0.168628 Aug 31 19:19:56.320924 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 400/805] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Aug 31 19:19:56 2022] DELETE /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb/os-volume_attachments/3515b79e-01e7-486c-aa74-2552b84a549d => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:19:56.331131 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-77ec3dad-4acd-46ca-a8df-a7379f315522 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:56.333317 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-77ec3dad-4acd-46ca-a8df-a7379f315522 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:56.341047 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-77ec3dad-4acd-46ca-a8df-a7379f315522 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:56.341565 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-77ec3dad-4acd-46ca-a8df-a7379f315522 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:56.342110 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-77ec3dad-4acd-46ca-a8df-a7379f315522 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:56.342844 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-77ec3dad-4acd-46ca-a8df-a7379f315522 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:56.343349 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-77ec3dad-4acd-46ca-a8df-a7379f315522 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:56.343773 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-77ec3dad-4acd-46ca-a8df-a7379f315522 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:56.373417 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-77ec3dad-4acd-46ca-a8df-a7379f315522 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047393 Aug 31 19:19:56.373969 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 406/806] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 31 19:19:56 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:19:56.432217 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-1657b175-7b37-43b9-8b9a-25bd7fa8ea3c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:56.432945 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-1657b175-7b37-43b9-8b9a-25bd7fa8ea3c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:56.439612 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1657b175-7b37-43b9-8b9a-25bd7fa8ea3c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:56.440091 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1657b175-7b37-43b9-8b9a-25bd7fa8ea3c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:56.440519 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1657b175-7b37-43b9-8b9a-25bd7fa8ea3c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:56.441211 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1657b175-7b37-43b9-8b9a-25bd7fa8ea3c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:56.441676 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1657b175-7b37-43b9-8b9a-25bd7fa8ea3c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:56.442091 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1657b175-7b37-43b9-8b9a-25bd7fa8ea3c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:56.576619 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1657b175-7b37-43b9-8b9a-25bd7fa8ea3c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:56.579003 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:56.586274 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-1657b175-7b37-43b9-8b9a-25bd7fa8ea3c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1519 microversion: 2.1 time: 0.158290 Aug 31 19:19:56.586873 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 401/807] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:56 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:57.386805 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-38c80b6b-d1e1-407a-8402-67d507a23277 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:57.389412 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-38c80b6b-d1e1-407a-8402-67d507a23277 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:57.397115 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-38c80b6b-d1e1-407a-8402-67d507a23277 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:57.397774 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-38c80b6b-d1e1-407a-8402-67d507a23277 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:57.398408 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-38c80b6b-d1e1-407a-8402-67d507a23277 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:57.399138 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-38c80b6b-d1e1-407a-8402-67d507a23277 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:57.399594 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-38c80b6b-d1e1-407a-8402-67d507a23277 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:57.400010 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-38c80b6b-d1e1-407a-8402-67d507a23277 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:57.434428 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-38c80b6b-d1e1-407a-8402-67d507a23277 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052855 Aug 31 19:19:57.435000 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 407/808] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 31 19:19:57 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:19:57.608850 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-13e5f298-7f7c-42fd-8e9c-1583fbc3dc3a tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:57.609523 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-13e5f298-7f7c-42fd-8e9c-1583fbc3dc3a tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:57.617154 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-13e5f298-7f7c-42fd-8e9c-1583fbc3dc3a tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:57.617659 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-13e5f298-7f7c-42fd-8e9c-1583fbc3dc3a tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:57.618083 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-13e5f298-7f7c-42fd-8e9c-1583fbc3dc3a tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:57.618756 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-13e5f298-7f7c-42fd-8e9c-1583fbc3dc3a tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:57.619199 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-13e5f298-7f7c-42fd-8e9c-1583fbc3dc3a tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:57.619608 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-13e5f298-7f7c-42fd-8e9c-1583fbc3dc3a tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:57.748520 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-13e5f298-7f7c-42fd-8e9c-1583fbc3dc3a tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:57.756757 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-13e5f298-7f7c-42fd-8e9c-1583fbc3dc3a tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1575 microversion: 2.1 time: 0.152270 Aug 31 19:19:57.757332 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 402/809] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:57 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:58.446898 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-ef276321-533a-4610-b4fb-829b79910d93 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:58.449204 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-ef276321-533a-4610-b4fb-829b79910d93 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:58.455582 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ef276321-533a-4610-b4fb-829b79910d93 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:58.456066 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ef276321-533a-4610-b4fb-829b79910d93 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:58.456498 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ef276321-533a-4610-b4fb-829b79910d93 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:58.457205 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ef276321-533a-4610-b4fb-829b79910d93 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:58.457661 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ef276321-533a-4610-b4fb-829b79910d93 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:58.458191 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ef276321-533a-4610-b4fb-829b79910d93 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:58.489332 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-ef276321-533a-4610-b4fb-829b79910d93 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046235 Aug 31 19:19:58.489821 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 408/810] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 31 19:19:58 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 19:19:58.552785 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-67531fbe-61c9-4a2f-86ec-628c868d7fe0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:58.553293 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-67531fbe-61c9-4a2f-86ec-628c868d7fe0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:58.559672 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-67531fbe-61c9-4a2f-86ec-628c868d7fe0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:58.560144 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-67531fbe-61c9-4a2f-86ec-628c868d7fe0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:58.560565 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-67531fbe-61c9-4a2f-86ec-628c868d7fe0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:58.561275 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-67531fbe-61c9-4a2f-86ec-628c868d7fe0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:58.561720 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-67531fbe-61c9-4a2f-86ec-628c868d7fe0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:58.562131 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-67531fbe-61c9-4a2f-86ec-628c868d7fe0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:58.587344 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-67531fbe-61c9-4a2f-86ec-628c868d7fe0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Going to try to terminate instance {{(pid=120623) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 19:19:58.660252 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-67531fbe-61c9-4a2f-86ec-628c868d7fe0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "DELETE /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 204 len: 0 microversion: 2.1 time: 0.110894 Aug 31 19:19:58.660958 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 403/811] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 31 19:19:58 2022] DELETE /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:19:58.668964 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-1969612c-6245-4e88-ad38-deb5d3f88bfb tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:58.669591 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-1969612c-6245-4e88-ad38-deb5d3f88bfb tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:58.675602 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1969612c-6245-4e88-ad38-deb5d3f88bfb tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:58.676255 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1969612c-6245-4e88-ad38-deb5d3f88bfb tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:58.676855 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1969612c-6245-4e88-ad38-deb5d3f88bfb tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:58.677738 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1969612c-6245-4e88-ad38-deb5d3f88bfb tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:58.678332 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1969612c-6245-4e88-ad38-deb5d3f88bfb tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:58.678894 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1969612c-6245-4e88-ad38-deb5d3f88bfb tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:58.778725 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d14ac20a-79d8-4434-a212-3d13255047e4 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:58.779424 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d14ac20a-79d8-4434-a212-3d13255047e4 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:58.785501 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d14ac20a-79d8-4434-a212-3d13255047e4 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:58.785994 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d14ac20a-79d8-4434-a212-3d13255047e4 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:58.786427 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d14ac20a-79d8-4434-a212-3d13255047e4 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:58.787120 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d14ac20a-79d8-4434-a212-3d13255047e4 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:58.787602 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d14ac20a-79d8-4434-a212-3d13255047e4 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:58.788022 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d14ac20a-79d8-4434-a212-3d13255047e4 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:58.813023 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-1969612c-6245-4e88-ad38-deb5d3f88bfb tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:58.820816 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-1969612c-6245-4e88-ad38-deb5d3f88bfb tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1680 microversion: 2.1 time: 0.155735 Aug 31 19:19:58.821476 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 409/812] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:58 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:58.918995 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-d14ac20a-79d8-4434-a212-3d13255047e4 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:58.926679 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-d14ac20a-79d8-4434-a212-3d13255047e4 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1575 microversion: 2.1 time: 0.152776 Aug 31 19:19:58.927242 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 404/813] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:58 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:19:59.842324 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-1e4d6e21-20e2-4cdc-bd00-e16e69ee858a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:59.842960 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-1e4d6e21-20e2-4cdc-bd00-e16e69ee858a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:59.849645 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1e4d6e21-20e2-4cdc-bd00-e16e69ee858a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:59.850129 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1e4d6e21-20e2-4cdc-bd00-e16e69ee858a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:59.850555 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1e4d6e21-20e2-4cdc-bd00-e16e69ee858a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:59.851264 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1e4d6e21-20e2-4cdc-bd00-e16e69ee858a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:59.851688 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1e4d6e21-20e2-4cdc-bd00-e16e69ee858a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:59.852107 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1e4d6e21-20e2-4cdc-bd00-e16e69ee858a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:59.947786 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-c63b035f-ce01-4f0e-b533-b78a36b55fbe tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:59.948531 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-c63b035f-ce01-4f0e-b533-b78a36b55fbe tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:59.955407 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c63b035f-ce01-4f0e-b533-b78a36b55fbe tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:59.955889 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c63b035f-ce01-4f0e-b533-b78a36b55fbe tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:59.956321 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c63b035f-ce01-4f0e-b533-b78a36b55fbe tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:59.957015 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c63b035f-ce01-4f0e-b533-b78a36b55fbe tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:59.957499 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c63b035f-ce01-4f0e-b533-b78a36b55fbe tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:59.957924 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c63b035f-ce01-4f0e-b533-b78a36b55fbe tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:59.979994 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-1e4d6e21-20e2-4cdc-bd00-e16e69ee858a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:59.987854 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-1e4d6e21-20e2-4cdc-bd00-e16e69ee858a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1680 microversion: 2.1 time: 0.149915 Aug 31 19:19:59.988535 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 410/814] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:59 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:00.091278 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-c63b035f-ce01-4f0e-b533-b78a36b55fbe tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:00.098950 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-c63b035f-ce01-4f0e-b533-b78a36b55fbe tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1575 microversion: 2.1 time: 0.154989 Aug 31 19:20:00.099768 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 405/815] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:59 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:01.009654 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-28df97bf-c235-4943-b6e0-789d4ed4185c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:01.010244 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-28df97bf-c235-4943-b6e0-789d4ed4185c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:01.016743 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-28df97bf-c235-4943-b6e0-789d4ed4185c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:01.017235 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-28df97bf-c235-4943-b6e0-789d4ed4185c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:01.017665 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-28df97bf-c235-4943-b6e0-789d4ed4185c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:01.018352 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-28df97bf-c235-4943-b6e0-789d4ed4185c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:01.018794 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-28df97bf-c235-4943-b6e0-789d4ed4185c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:01.019208 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-28df97bf-c235-4943-b6e0-789d4ed4185c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:01.121840 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-cb6bdb28-0afc-4640-b843-6e149e6071ee tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:01.122460 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-cb6bdb28-0afc-4640-b843-6e149e6071ee tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:01.129381 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cb6bdb28-0afc-4640-b843-6e149e6071ee tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:01.129877 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cb6bdb28-0afc-4640-b843-6e149e6071ee tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:01.130314 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cb6bdb28-0afc-4640-b843-6e149e6071ee tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:01.131011 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cb6bdb28-0afc-4640-b843-6e149e6071ee tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:01.131862 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cb6bdb28-0afc-4640-b843-6e149e6071ee tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:01.132295 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cb6bdb28-0afc-4640-b843-6e149e6071ee tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:01.158814 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-28df97bf-c235-4943-b6e0-789d4ed4185c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:01.167333 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-28df97bf-c235-4943-b6e0-789d4ed4185c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1680 microversion: 2.1 time: 0.161026 Aug 31 19:20:01.167900 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 411/816] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:01 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:01.335279 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-cb6bdb28-0afc-4640-b843-6e149e6071ee tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:01.344091 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-cb6bdb28-0afc-4640-b843-6e149e6071ee tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1575 microversion: 2.1 time: 0.226861 Aug 31 19:20:01.344712 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 406/817] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:01 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1575 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:01.700312 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-53b2b321-c55e-4037-95ba-0cd46c6379c4 req-6fad2211-8d77-4747-858e-4a7a80d849d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb", "name": "network-vif-deleted", "tag": "1adf99e2-adb2-4055-815e-64ce31792411"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:20:01.709562 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-53b2b321-c55e-4037-95ba-0cd46c6379c4 req-6fad2211-8d77-4747-858e-4a7a80d849d2 service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:01.710050 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-53b2b321-c55e-4037-95ba-0cd46c6379c4 req-6fad2211-8d77-4747-858e-4a7a80d849d2 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:01.710477 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-53b2b321-c55e-4037-95ba-0cd46c6379c4 req-6fad2211-8d77-4747-858e-4a7a80d849d2 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:01.722212 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-53b2b321-c55e-4037-95ba-0cd46c6379c4 req-6fad2211-8d77-4747-858e-4a7a80d849d2 service nova] Creating event network-vif-deleted:1adf99e2-adb2-4055-815e-64ce31792411 for instance e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb on hv-cinder-83538 Aug 31 19:20:01.727581 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-53b2b321-c55e-4037-95ba-0cd46c6379c4 req-6fad2211-8d77-4747-858e-4a7a80d849d2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031916 Aug 31 19:20:01.728204 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 412/818] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:20:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:20:02.188627 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-231e878b-7398-4ed1-bef9-0dd94a27cc31 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:02.189391 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-231e878b-7398-4ed1-bef9-0dd94a27cc31 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:02.196625 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-231e878b-7398-4ed1-bef9-0dd94a27cc31 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:02.197118 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-231e878b-7398-4ed1-bef9-0dd94a27cc31 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:02.197616 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-231e878b-7398-4ed1-bef9-0dd94a27cc31 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:02.198912 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-231e878b-7398-4ed1-bef9-0dd94a27cc31 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:02.199549 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-231e878b-7398-4ed1-bef9-0dd94a27cc31 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:02.199974 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-231e878b-7398-4ed1-bef9-0dd94a27cc31 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:02.231962 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-231e878b-7398-4ed1-bef9-0dd94a27cc31 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:02.232445 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-231e878b-7398-4ed1-bef9-0dd94a27cc31 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:02.232874 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-231e878b-7398-4ed1-bef9-0dd94a27cc31 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:02.233350 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.objects.instance [None req-231e878b-7398-4ed1-bef9-0dd94a27cc31 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lazy-loading 'fault' on Instance uuid e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb {{(pid=120623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:20:02.276683 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-231e878b-7398-4ed1-bef9-0dd94a27cc31 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:02.284491 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-231e878b-7398-4ed1-bef9-0dd94a27cc31 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 200 len: 1331 microversion: 2.1 time: 0.099881 Aug 31 19:20:02.285059 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 407/819] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:02 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 1331 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:02.367141 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-4432edfc-9407-42c2-9221-97b8d7685058 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:02.367836 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-4432edfc-9407-42c2-9221-97b8d7685058 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:02.374599 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4432edfc-9407-42c2-9221-97b8d7685058 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:02.375090 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4432edfc-9407-42c2-9221-97b8d7685058 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:02.375520 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4432edfc-9407-42c2-9221-97b8d7685058 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:02.376208 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4432edfc-9407-42c2-9221-97b8d7685058 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:02.376653 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4432edfc-9407-42c2-9221-97b8d7685058 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:02.377068 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4432edfc-9407-42c2-9221-97b8d7685058 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:02.523355 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-4432edfc-9407-42c2-9221-97b8d7685058 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:02.531493 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-4432edfc-9407-42c2-9221-97b8d7685058 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1575 microversion: 2.1 time: 0.169083 Aug 31 19:20:02.532056 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 413/820] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:02 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:03.304638 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-6f9c27fc-46cc-4209-80ce-2448e2c39d88 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:03.305292 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-6f9c27fc-46cc-4209-80ce-2448e2c39d88 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:03.311803 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6f9c27fc-46cc-4209-80ce-2448e2c39d88 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:03.312276 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6f9c27fc-46cc-4209-80ce-2448e2c39d88 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:03.312697 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6f9c27fc-46cc-4209-80ce-2448e2c39d88 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:03.313409 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6f9c27fc-46cc-4209-80ce-2448e2c39d88 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:03.313851 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6f9c27fc-46cc-4209-80ce-2448e2c39d88 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:03.314261 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6f9c27fc-46cc-4209-80ce-2448e2c39d88 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:03.329633 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.wsgi [None req-6f9c27fc-46cc-4209-80ce-2448e2c39d88 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] HTTP exception thrown: Instance e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb could not be found. Aug 31 19:20:03.331207 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-6f9c27fc-46cc-4209-80ce-2448e2c39d88 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Request method failure captured: Aug 31 19:20:03.331207 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: request: GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb HTTP/1.1 Aug 31 19:20:03.331207 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Accept: application/json Aug 31 19:20:03.331207 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Accept-Encoding: identity Aug 31 19:20:03.331207 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Connection: close Aug 31 19:20:03.331207 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Content-Length: 0 Aug 31 19:20:03.331207 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Content-Type: application/json Aug 31 19:20:03.331207 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Host: 10.222.0.65 Aug 31 19:20:03.331207 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Openstack-System-Scope: None Aug 31 19:20:03.331207 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: User-Agent: python-urllib3/1.26.12 Aug 31 19:20:03.331207 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Auth-Token: gAAAAABjD7KQFx_CTgljpc_qTbwt7yeZ02hQJcRRTGjLujiMjCCm-y4KZuXdAcd8yicyJshoDc3mgcG2dVFxaRyv0OYT2U8p5W3ZDfvXP2qQyvl9GhMqVycMoUFtordGBMOd64j9xBsCCsuy7lF-JjelfCeTLgdgY5owS10WSU3cjBe8ulEuuUA Aug 31 19:20:03.331207 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Domain-Id: None Aug 31 19:20:03.331207 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Domain-Name: None Aug 31 19:20:03.331207 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Identity-Status: Confirmed Aug 31 19:20:03.331207 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Is-Admin-Project: True Aug 31 19:20:03.331207 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Id: default Aug 31 19:20:03.331207 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Name: Default Aug 31 19:20:03.331207 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Id: e6d782400f1e432c8d10a31334c42e68 Aug 31 19:20:03.331207 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Name: tempest-AttachVolumeNegativeTest-739769459 Aug 31 19:20:03.331207 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Role: member,reader Aug 31 19:20:03.331207 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Roles: member,reader Aug 31 19:20:03.332786 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/e6d782400f1e432c8d10a31334c42e68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e6d782400f1e432c8d10a31334c42e68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_e6d782400f1e432c8d10a31334c42e68", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e6d782400f1e432c8d10a31334c42e68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:20:03.332786 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant: tempest-AttachVolumeNegativeTest-739769459 Aug 31 19:20:03.332786 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant-Id: e6d782400f1e432c8d10a31334c42e68 Aug 31 19:20:03.332786 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-739769459 Aug 31 19:20:03.332786 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User: tempest-AttachVolumeNegativeTest-739769459-project Aug 31 19:20:03.332786 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Id: default Aug 31 19:20:03.332786 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Name: Default Aug 31 19:20:03.332786 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Id: 0bfa1533b0944bd681f4c2a33cf701b0 Aug 31 19:20:03.332786 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Name: tempest-AttachVolumeNegativeTest-739769459-project Aug 31 19:20:03.332786 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: method: > Aug 31 19:20:03.332786 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: exception: Instance e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb could not be found. Aug 31 19:20:03.332786 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: action_args: {'id': 'e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb'} Aug 31 19:20:03.333886 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:20:03.333886 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:20:03.333886 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:20:03.333886 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:20:03.333886 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:20:03.333886 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:20:03.333886 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:20:03.333886 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:20:03.333886 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:20:03.333886 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:20:03.333886 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb could not be found. Aug 31 19:20:03.333886 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:20:03.333886 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:20:03.333886 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:20:03.333886 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:20:03.333886 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:20:03.333886 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:20:03.333886 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:20:03.333886 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:20:03.333886 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:20:03.335360 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:20:03.335360 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:20:03.335360 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:20:03.335360 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:20:03.335360 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:20:03.335360 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:20:03.335360 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:20:03.335360 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb could not be found. Aug 31 19:20:03.335360 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:20:03.335360 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:20:03.335360 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:20:03.335360 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:20:03.335360 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:20:03.335360 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:20:03.335360 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:20:03.335360 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:20:03.335360 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb could not be found. Aug 31 19:20:03.335360 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:20:03.336787 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-6f9c27fc-46cc-4209-80ce-2448e2c39d88 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Returning 404 to user: Instance e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb could not be found. {{(pid=120623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:20:03.336787 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-6f9c27fc-46cc-4209-80ce-2448e2c39d88 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 404 len: 111 microversion: 2.1 time: 0.031712 Aug 31 19:20:03.336787 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 408/821] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:03 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:20:03.342280 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-7b9fc776-a3cb-47d7-b411-d6b81402c3e7 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '.version_select at 0x7fdb89c6a550>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:03.361025 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-7b9fc776-a3cb-47d7-b411-d6b81402c3e7 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-126454859" status: 202 len: 0 microversion: 2.1 time: 0.023428 Aug 31 19:20:03.361617 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 414/822] 10.222.0.65 () {58 vars in 1218 bytes} [Wed Aug 31 19:20:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-126454859 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:20:03.553279 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-eb91883e-16a1-4355-9e18-cf9e8b4ca64a tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:03.554028 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-eb91883e-16a1-4355-9e18-cf9e8b4ca64a tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:03.560593 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-eb91883e-16a1-4355-9e18-cf9e8b4ca64a tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:03.561083 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-eb91883e-16a1-4355-9e18-cf9e8b4ca64a tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:03.561541 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-eb91883e-16a1-4355-9e18-cf9e8b4ca64a tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:03.562418 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-eb91883e-16a1-4355-9e18-cf9e8b4ca64a tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:03.562875 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-eb91883e-16a1-4355-9e18-cf9e8b4ca64a tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:03.563298 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-eb91883e-16a1-4355-9e18-cf9e8b4ca64a tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:03.700658 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-eb91883e-16a1-4355-9e18-cf9e8b4ca64a tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:03.708418 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-eb91883e-16a1-4355-9e18-cf9e8b4ca64a tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1575 microversion: 2.1 time: 0.159093 Aug 31 19:20:03.708981 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 409/823] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:03 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:03.992031 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-77af36e1-4ac7-4f17-b331-9b9ec42339b8 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Action: 'create', calling method: .version_select at 0x7fdb89caa940>, body: {"keypair": {"name": "tempest-keypair-10397921", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHW+AAvPyN+pg5IIdEesk3ouaBHyDqQwFmdFXPfLGnOQW43RV5/P3F0aJdyo8VLRa9GhU2PtG3LNza2sEF6hlJp42IrnpW4hgFru9ZX5DQmrqkITZ3NHdzJy+QQVSOZnFA=="}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:20:04.008245 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-77af36e1-4ac7-4f17-b331-9b9ec42339b8 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Getting quotas for project e6d782400f1e432c8d10a31334c42e68. Resources: {'key_pairs'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:20:04.012051 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-77af36e1-4ac7-4f17-b331-9b9ec42339b8 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Getting quotas for user 0bfa1533b0944bd681f4c2a33cf701b0 and project e6d782400f1e432c8d10a31334c42e68. Resources: {'key_pairs'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:20:04.033598 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-77af36e1-4ac7-4f17-b331-9b9ec42339b8 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.045916 Aug 31 19:20:04.034176 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 415/824] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Aug 31 19:20:03 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:20:04.730968 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d5df933e-7013-4101-9590-23a81abff4c1 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:04.731559 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d5df933e-7013-4101-9590-23a81abff4c1 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:04.738270 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d5df933e-7013-4101-9590-23a81abff4c1 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:04.738749 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d5df933e-7013-4101-9590-23a81abff4c1 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:04.739181 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d5df933e-7013-4101-9590-23a81abff4c1 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:04.739867 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d5df933e-7013-4101-9590-23a81abff4c1 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:04.740320 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d5df933e-7013-4101-9590-23a81abff4c1 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:04.740736 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d5df933e-7013-4101-9590-23a81abff4c1 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:04.879084 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-d5df933e-7013-4101-9590-23a81abff4c1 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:04.887706 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-d5df933e-7013-4101-9590-23a81abff4c1 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1575 microversion: 2.1 time: 0.160899 Aug 31 19:20:04.888468 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 410/825] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:04 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:05.300152 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-8b488e3c-9bdd-405c-ba3c-9e5c6349c44a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1981038859", "imageRef": "f4f2ae76-bacc-4449-881b-f697e1eeec66", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3d3f0557-9886-408b-a53b-c6736a0907d4"}], "security_groups": [{"name": "tempest-securitygroup--949805209"}], "key_name": "tempest-keypair-10397921", "user_data": "}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:20:05.410070 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.network.neutron [None req-8b488e3c-9bdd-405c-ba3c-9e5c6349c44a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] validate_networks() for [('3d3f0557-9886-408b-a53b-c6736a0907d4', None, None, None, None, None)] {{(pid=120624) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:20:05.784878 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-8b488e3c-9bdd-405c-ba3c-9e5c6349c44a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Flavor limits 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:20:05.785327 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-8b488e3c-9bdd-405c-ba3c-9e5c6349c44a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Image limits 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:20:05.785802 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-8b488e3c-9bdd-405c-ba3c-9e5c6349c44a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Flavor pref 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:20:05.786203 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-8b488e3c-9bdd-405c-ba3c-9e5c6349c44a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Image pref 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:20:05.786608 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-8b488e3c-9bdd-405c-ba3c-9e5c6349c44a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:20:05.795983 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8b488e3c-9bdd-405c-ba3c-9e5c6349c44a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:05.796455 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8b488e3c-9bdd-405c-ba3c-9e5c6349c44a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:05.796880 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8b488e3c-9bdd-405c-ba3c-9e5c6349c44a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:05.797629 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8b488e3c-9bdd-405c-ba3c-9e5c6349c44a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:05.798079 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8b488e3c-9bdd-405c-ba3c-9e5c6349c44a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:05.798521 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8b488e3c-9bdd-405c-ba3c-9e5c6349c44a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:05.815404 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-8b488e3c-9bdd-405c-ba3c-9e5c6349c44a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Getting quotas for project e6d782400f1e432c8d10a31334c42e68. Resources: {'instances', 'cores', 'ram'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:20:05.819285 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-8b488e3c-9bdd-405c-ba3c-9e5c6349c44a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Getting quotas for user 0bfa1533b0944bd681f4c2a33cf701b0 and project e6d782400f1e432c8d10a31334c42e68. Resources: {'instances', 'cores', 'ram'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:20:05.829989 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-8b488e3c-9bdd-405c-ba3c-9e5c6349c44a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Going to run 1 instances... {{(pid=120624) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:20:05.832220 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-8b488e3c-9bdd-405c-ba3c-9e5c6349c44a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: 0ae1a222-b48a-4e85-8c65-5d3dccd56f1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f4f2ae76-bacc-4449-881b-f697e1eeec66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120624) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:20:05.852781 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:05.880706 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-8b488e3c-9bdd-405c-ba3c-9e5c6349c44a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.584642 Aug 31 19:20:05.881371 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 416/826] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 31 19:20:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 19:20:05.892047 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-16235115-a29b-41c6-89b2-01f8e7f003af tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:05.892657 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-16235115-a29b-41c6-89b2-01f8e7f003af tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: 0ae1a222-b48a-4e85-8c65-5d3dccd56f1e] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:05.911226 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-a53a2a7d-ddec-4967-a81e-1b3c2ae8d562 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:05.911852 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-a53a2a7d-ddec-4967-a81e-1b3c2ae8d562 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:05.920233 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a53a2a7d-ddec-4967-a81e-1b3c2ae8d562 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:05.920816 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a53a2a7d-ddec-4967-a81e-1b3c2ae8d562 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:05.921436 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a53a2a7d-ddec-4967-a81e-1b3c2ae8d562 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:05.922136 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a53a2a7d-ddec-4967-a81e-1b3c2ae8d562 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:05.922590 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a53a2a7d-ddec-4967-a81e-1b3c2ae8d562 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:05.923011 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a53a2a7d-ddec-4967-a81e-1b3c2ae8d562 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:05.927467 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=100 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:05.952181 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-16235115-a29b-41c6-89b2-01f8e7f003af tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:05.959742 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-16235115-a29b-41c6-89b2-01f8e7f003af tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/0ae1a222-b48a-4e85-8c65-5d3dccd56f1e" status: 200 len: 1240 microversion: 2.1 time: 0.071549 Aug 31 19:20:05.960314 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 411/827] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:05 2022] GET /compute/v2.1/servers/0ae1a222-b48a-4e85-8c65-5d3dccd56f1e => generated 1240 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:06.061381 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-a53a2a7d-ddec-4967-a81e-1b3c2ae8d562 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:06.069077 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-a53a2a7d-ddec-4967-a81e-1b3c2ae8d562 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1575 microversion: 2.1 time: 0.163526 Aug 31 19:20:06.069679 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 417/828] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:05 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:20:06.981221 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-758582ad-2670-43a9-ae89-5b46d63e6a7a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:06.981777 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-758582ad-2670-43a9-ae89-5b46d63e6a7a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: 0ae1a222-b48a-4e85-8c65-5d3dccd56f1e] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:06.988107 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-758582ad-2670-43a9-ae89-5b46d63e6a7a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:06.988584 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-758582ad-2670-43a9-ae89-5b46d63e6a7a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:06.989070 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-758582ad-2670-43a9-ae89-5b46d63e6a7a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:06.989820 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-758582ad-2670-43a9-ae89-5b46d63e6a7a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:06.990305 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-758582ad-2670-43a9-ae89-5b46d63e6a7a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:06.990680 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-758582ad-2670-43a9-ae89-5b46d63e6a7a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:07.054700 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-758582ad-2670-43a9-ae89-5b46d63e6a7a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:07.064115 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-758582ad-2670-43a9-ae89-5b46d63e6a7a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/0ae1a222-b48a-4e85-8c65-5d3dccd56f1e" status: 200 len: 1292 microversion: 2.1 time: 0.087025 Aug 31 19:20:07.064688 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 412/829] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:06 2022] GET /compute/v2.1/servers/0ae1a222-b48a-4e85-8c65-5d3dccd56f1e => generated 1292 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:07.091523 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-89a0bf08-5886-4316-b75a-e684232f29f7 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:07.092131 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-89a0bf08-5886-4316-b75a-e684232f29f7 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:07.098922 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-89a0bf08-5886-4316-b75a-e684232f29f7 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:07.099695 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-89a0bf08-5886-4316-b75a-e684232f29f7 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:07.100120 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-89a0bf08-5886-4316-b75a-e684232f29f7 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:07.100802 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-89a0bf08-5886-4316-b75a-e684232f29f7 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:07.101489 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-89a0bf08-5886-4316-b75a-e684232f29f7 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:07.102092 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-89a0bf08-5886-4316-b75a-e684232f29f7 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:07.257579 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-89a0bf08-5886-4316-b75a-e684232f29f7 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:07.265513 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-89a0bf08-5886-4316-b75a-e684232f29f7 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1575 microversion: 2.1 time: 0.178052 Aug 31 19:20:07.266137 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 418/830] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:07 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1575 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:08.084599 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-1e2d0750-39c0-4f06-9156-a8b8be86c7b0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:08.085264 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-1e2d0750-39c0-4f06-9156-a8b8be86c7b0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: 0ae1a222-b48a-4e85-8c65-5d3dccd56f1e] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:08.093256 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1e2d0750-39c0-4f06-9156-a8b8be86c7b0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:08.094051 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1e2d0750-39c0-4f06-9156-a8b8be86c7b0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:08.094681 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1e2d0750-39c0-4f06-9156-a8b8be86c7b0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:08.095624 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1e2d0750-39c0-4f06-9156-a8b8be86c7b0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:08.096274 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1e2d0750-39c0-4f06-9156-a8b8be86c7b0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:08.096706 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1e2d0750-39c0-4f06-9156-a8b8be86c7b0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:08.280002 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1e2d0750-39c0-4f06-9156-a8b8be86c7b0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:08.286981 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-669eb93e-e8b4-495c-83f0-e167a78b3a87 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:08.288176 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-669eb93e-e8b4-495c-83f0-e167a78b3a87 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:08.288787 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-1e2d0750-39c0-4f06-9156-a8b8be86c7b0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/0ae1a222-b48a-4e85-8c65-5d3dccd56f1e" status: 200 len: 1365 microversion: 2.1 time: 0.208075 Aug 31 19:20:08.301725 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 413/831] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:08 2022] GET /compute/v2.1/servers/0ae1a222-b48a-4e85-8c65-5d3dccd56f1e => generated 1365 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:08.308148 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-669eb93e-e8b4-495c-83f0-e167a78b3a87 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:08.309149 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-669eb93e-e8b4-495c-83f0-e167a78b3a87 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:08.309608 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-669eb93e-e8b4-495c-83f0-e167a78b3a87 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:08.310312 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-669eb93e-e8b4-495c-83f0-e167a78b3a87 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:08.310765 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-669eb93e-e8b4-495c-83f0-e167a78b3a87 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:08.311185 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-669eb93e-e8b4-495c-83f0-e167a78b3a87 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:08.481526 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-669eb93e-e8b4-495c-83f0-e167a78b3a87 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:08.489933 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-669eb93e-e8b4-495c-83f0-e167a78b3a87 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1575 microversion: 2.1 time: 0.206610 Aug 31 19:20:08.490707 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 419/832] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:08 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1575 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:08.549725 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-a651cccf-7597-47c7-b3ae-7135f8056f79 req-86fe4abb-84bd-4d0a-9893-b5c7e8e3e6d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52d843ca-5f08-47f6-98dc-2df1d30438cc", "name": "network-vif-plugged", "status": "completed", "tag": "4fdbfd0c-e43a-4c2c-ab61-0f67e2dfee09"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:20:08.561340 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-2f12b8ee-7f68-4157-9425-53428b9785cc req-720d19d5-d82c-4db2-b428-158d44e3452b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ae1a222-b48a-4e85-8c65-5d3dccd56f1e", "tag": "f8252d75-812c-42e5-ae8c-3758c5342769"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:20:08.570045 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-a651cccf-7597-47c7-b3ae-7135f8056f79 req-86fe4abb-84bd-4d0a-9893-b5c7e8e3e6d4 service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:08.576943 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-2f12b8ee-7f68-4157-9425-53428b9785cc req-720d19d5-d82c-4db2-b428-158d44e3452b service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:08.577452 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-2f12b8ee-7f68-4157-9425-53428b9785cc req-720d19d5-d82c-4db2-b428-158d44e3452b service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:08.577875 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-2f12b8ee-7f68-4157-9425-53428b9785cc req-720d19d5-d82c-4db2-b428-158d44e3452b service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:08.582137 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-a651cccf-7597-47c7-b3ae-7135f8056f79 req-86fe4abb-84bd-4d0a-9893-b5c7e8e3e6d4 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:08.582862 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-a651cccf-7597-47c7-b3ae-7135f8056f79 req-86fe4abb-84bd-4d0a-9893-b5c7e8e3e6d4 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:08.594157 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-2f12b8ee-7f68-4157-9425-53428b9785cc req-720d19d5-d82c-4db2-b428-158d44e3452b service nova] Creating event network-changed:f8252d75-812c-42e5-ae8c-3758c5342769 for instance 0ae1a222-b48a-4e85-8c65-5d3dccd56f1e on hv-cinder-83538 Aug 31 19:20:08.601777 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-a651cccf-7597-47c7-b3ae-7135f8056f79 req-86fe4abb-84bd-4d0a-9893-b5c7e8e3e6d4 service nova] Creating event network-vif-plugged:4fdbfd0c-e43a-4c2c-ab61-0f67e2dfee09 for instance 52d843ca-5f08-47f6-98dc-2df1d30438cc on hv-cinder-83538 Aug 31 19:20:08.609909 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-a651cccf-7597-47c7-b3ae-7135f8056f79 req-86fe4abb-84bd-4d0a-9893-b5c7e8e3e6d4 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064282 Aug 31 19:20:08.610450 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-2f12b8ee-7f68-4157-9425-53428b9785cc req-720d19d5-d82c-4db2-b428-158d44e3452b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053259 Aug 31 19:20:08.612026 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 420/833] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:20:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:20:08.614300 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 414/834] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:20:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:20:09.309964 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-8ab3870b-cf7f-4a06-b2fb-65b9219279f2 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:09.310664 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-8ab3870b-cf7f-4a06-b2fb-65b9219279f2 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: 0ae1a222-b48a-4e85-8c65-5d3dccd56f1e] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:09.317374 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8ab3870b-cf7f-4a06-b2fb-65b9219279f2 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:09.317850 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8ab3870b-cf7f-4a06-b2fb-65b9219279f2 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:09.318279 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8ab3870b-cf7f-4a06-b2fb-65b9219279f2 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:09.318983 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8ab3870b-cf7f-4a06-b2fb-65b9219279f2 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:09.319428 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8ab3870b-cf7f-4a06-b2fb-65b9219279f2 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:09.319841 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8ab3870b-cf7f-4a06-b2fb-65b9219279f2 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:09.448681 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-8ab3870b-cf7f-4a06-b2fb-65b9219279f2 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:09.456464 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-8ab3870b-cf7f-4a06-b2fb-65b9219279f2 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/0ae1a222-b48a-4e85-8c65-5d3dccd56f1e" status: 200 len: 1365 microversion: 2.1 time: 0.150669 Aug 31 19:20:09.457034 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 421/835] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:09 2022] GET /compute/v2.1/servers/0ae1a222-b48a-4e85-8c65-5d3dccd56f1e => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:09.513365 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-578464eb-675c-4fe3-a294-da31cde85261 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:09.514056 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-578464eb-675c-4fe3-a294-da31cde85261 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:09.520196 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-578464eb-675c-4fe3-a294-da31cde85261 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:09.520680 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-578464eb-675c-4fe3-a294-da31cde85261 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:09.521109 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-578464eb-675c-4fe3-a294-da31cde85261 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:09.521826 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-578464eb-675c-4fe3-a294-da31cde85261 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:09.522286 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-578464eb-675c-4fe3-a294-da31cde85261 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:09.522704 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-578464eb-675c-4fe3-a294-da31cde85261 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:09.650444 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-578464eb-675c-4fe3-a294-da31cde85261 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:09.658654 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-578464eb-675c-4fe3-a294-da31cde85261 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1575 microversion: 2.1 time: 0.150665 Aug 31 19:20:09.659225 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 415/836] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:09 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:10.477559 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-ae58e9e3-7c00-4440-a010-9283fd7d939c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:10.478170 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-ae58e9e3-7c00-4440-a010-9283fd7d939c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: 0ae1a222-b48a-4e85-8c65-5d3dccd56f1e] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:10.485351 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ae58e9e3-7c00-4440-a010-9283fd7d939c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:10.485829 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ae58e9e3-7c00-4440-a010-9283fd7d939c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:10.486258 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ae58e9e3-7c00-4440-a010-9283fd7d939c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:10.486935 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ae58e9e3-7c00-4440-a010-9283fd7d939c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:10.487378 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ae58e9e3-7c00-4440-a010-9283fd7d939c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:10.487792 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ae58e9e3-7c00-4440-a010-9283fd7d939c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:10.617164 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-ae58e9e3-7c00-4440-a010-9283fd7d939c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:10.624798 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-ae58e9e3-7c00-4440-a010-9283fd7d939c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/0ae1a222-b48a-4e85-8c65-5d3dccd56f1e" status: 200 len: 1365 microversion: 2.1 time: 0.151415 Aug 31 19:20:10.625378 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 422/837] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:10 2022] GET /compute/v2.1/servers/0ae1a222-b48a-4e85-8c65-5d3dccd56f1e => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:10.678914 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-ed892009-3cde-41f8-a146-5798c793ebf8 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:10.679540 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-ed892009-3cde-41f8-a146-5798c793ebf8 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:10.685988 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ed892009-3cde-41f8-a146-5798c793ebf8 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:10.686460 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ed892009-3cde-41f8-a146-5798c793ebf8 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:10.686883 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ed892009-3cde-41f8-a146-5798c793ebf8 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:10.687559 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ed892009-3cde-41f8-a146-5798c793ebf8 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:10.688001 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ed892009-3cde-41f8-a146-5798c793ebf8 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:10.688408 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ed892009-3cde-41f8-a146-5798c793ebf8 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:10.827363 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-ed892009-3cde-41f8-a146-5798c793ebf8 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:10.834996 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-ed892009-3cde-41f8-a146-5798c793ebf8 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1575 microversion: 2.1 time: 0.159901 Aug 31 19:20:10.835560 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 416/838] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:10 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:11.645566 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-deff845f-32df-4aa4-bc4f-e7ff9ca4a576 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:11.646188 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-deff845f-32df-4aa4-bc4f-e7ff9ca4a576 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: 0ae1a222-b48a-4e85-8c65-5d3dccd56f1e] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:11.653488 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-deff845f-32df-4aa4-bc4f-e7ff9ca4a576 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:11.654071 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-deff845f-32df-4aa4-bc4f-e7ff9ca4a576 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:11.654574 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-deff845f-32df-4aa4-bc4f-e7ff9ca4a576 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:11.655338 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-deff845f-32df-4aa4-bc4f-e7ff9ca4a576 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:11.655871 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-deff845f-32df-4aa4-bc4f-e7ff9ca4a576 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:11.656350 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-deff845f-32df-4aa4-bc4f-e7ff9ca4a576 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:11.784914 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-deff845f-32df-4aa4-bc4f-e7ff9ca4a576 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:11.792558 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-deff845f-32df-4aa4-bc4f-e7ff9ca4a576 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/0ae1a222-b48a-4e85-8c65-5d3dccd56f1e" status: 200 len: 1365 microversion: 2.1 time: 0.150842 Aug 31 19:20:11.793130 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 423/839] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:11 2022] GET /compute/v2.1/servers/0ae1a222-b48a-4e85-8c65-5d3dccd56f1e => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:11.858228 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-79e81dd3-5d94-463e-9a7f-2690f27d4ec8 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:11.859467 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-79e81dd3-5d94-463e-9a7f-2690f27d4ec8 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:11.865850 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-79e81dd3-5d94-463e-9a7f-2690f27d4ec8 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:11.866329 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-79e81dd3-5d94-463e-9a7f-2690f27d4ec8 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:11.866755 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-79e81dd3-5d94-463e-9a7f-2690f27d4ec8 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:11.867428 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-79e81dd3-5d94-463e-9a7f-2690f27d4ec8 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:11.867876 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-79e81dd3-5d94-463e-9a7f-2690f27d4ec8 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:11.868293 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-79e81dd3-5d94-463e-9a7f-2690f27d4ec8 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:11.996579 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-79e81dd3-5d94-463e-9a7f-2690f27d4ec8 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:12.004317 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-79e81dd3-5d94-463e-9a7f-2690f27d4ec8 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1575 microversion: 2.1 time: 0.149899 Aug 31 19:20:12.004881 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 417/840] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:11 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:12.813394 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-5d1e4ff1-ad29-470a-852a-bcff9b21926f tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:12.814031 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-5d1e4ff1-ad29-470a-852a-bcff9b21926f tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: 0ae1a222-b48a-4e85-8c65-5d3dccd56f1e] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:12.820314 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5d1e4ff1-ad29-470a-852a-bcff9b21926f tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:12.820793 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5d1e4ff1-ad29-470a-852a-bcff9b21926f tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:12.821249 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5d1e4ff1-ad29-470a-852a-bcff9b21926f tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:12.821970 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5d1e4ff1-ad29-470a-852a-bcff9b21926f tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:12.822419 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5d1e4ff1-ad29-470a-852a-bcff9b21926f tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:12.823328 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5d1e4ff1-ad29-470a-852a-bcff9b21926f tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:12.957367 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-5d1e4ff1-ad29-470a-852a-bcff9b21926f tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:12.965519 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-5d1e4ff1-ad29-470a-852a-bcff9b21926f tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/0ae1a222-b48a-4e85-8c65-5d3dccd56f1e" status: 200 len: 1365 microversion: 2.1 time: 0.155985 Aug 31 19:20:12.966082 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 424/841] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:12 2022] GET /compute/v2.1/servers/0ae1a222-b48a-4e85-8c65-5d3dccd56f1e => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:20:13.026594 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-9acbc11c-e473-4bf1-9d2c-3e4a062869d6 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:13.027244 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-9acbc11c-e473-4bf1-9d2c-3e4a062869d6 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:13.033542 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9acbc11c-e473-4bf1-9d2c-3e4a062869d6 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:13.034016 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9acbc11c-e473-4bf1-9d2c-3e4a062869d6 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:13.034440 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9acbc11c-e473-4bf1-9d2c-3e4a062869d6 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:13.035109 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9acbc11c-e473-4bf1-9d2c-3e4a062869d6 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:13.035551 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9acbc11c-e473-4bf1-9d2c-3e4a062869d6 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:13.035962 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9acbc11c-e473-4bf1-9d2c-3e4a062869d6 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:13.169572 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-9acbc11c-e473-4bf1-9d2c-3e4a062869d6 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:13.172226 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:13.179800 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-9acbc11c-e473-4bf1-9d2c-3e4a062869d6 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1562 microversion: 2.1 time: 0.157722 Aug 31 19:20:13.180577 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 418/842] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:13 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1562 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:13.986314 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-03223ce3-fd7c-4741-8d14-c9ff7fa23094 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:13.986862 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-03223ce3-fd7c-4741-8d14-c9ff7fa23094 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: 0ae1a222-b48a-4e85-8c65-5d3dccd56f1e] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:13.993153 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-03223ce3-fd7c-4741-8d14-c9ff7fa23094 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:13.993666 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-03223ce3-fd7c-4741-8d14-c9ff7fa23094 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:13.994092 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-03223ce3-fd7c-4741-8d14-c9ff7fa23094 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:13.994796 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-03223ce3-fd7c-4741-8d14-c9ff7fa23094 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:13.995243 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-03223ce3-fd7c-4741-8d14-c9ff7fa23094 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:13.995660 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-03223ce3-fd7c-4741-8d14-c9ff7fa23094 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:14.122338 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-03223ce3-fd7c-4741-8d14-c9ff7fa23094 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:14.129840 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-03223ce3-fd7c-4741-8d14-c9ff7fa23094 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/0ae1a222-b48a-4e85-8c65-5d3dccd56f1e" status: 200 len: 1365 microversion: 2.1 time: 0.147460 Aug 31 19:20:14.130409 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 425/843] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:13 2022] GET /compute/v2.1/servers/0ae1a222-b48a-4e85-8c65-5d3dccd56f1e => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:14.535991 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-f4ba2dfa-25f3-4c84-bb29-937ce3f8d8d0 req-d15ab978-eaa9-4805-9128-8dea89981bd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ae1a222-b48a-4e85-8c65-5d3dccd56f1e", "name": "network-vif-plugged", "status": "completed", "tag": "f8252d75-812c-42e5-ae8c-3758c5342769"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:20:14.546744 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-f4ba2dfa-25f3-4c84-bb29-937ce3f8d8d0 req-d15ab978-eaa9-4805-9128-8dea89981bd8 service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:14.547245 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-f4ba2dfa-25f3-4c84-bb29-937ce3f8d8d0 req-d15ab978-eaa9-4805-9128-8dea89981bd8 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:14.547664 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-f4ba2dfa-25f3-4c84-bb29-937ce3f8d8d0 req-d15ab978-eaa9-4805-9128-8dea89981bd8 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:14.558848 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-f4ba2dfa-25f3-4c84-bb29-937ce3f8d8d0 req-d15ab978-eaa9-4805-9128-8dea89981bd8 service nova] Creating event network-vif-plugged:f8252d75-812c-42e5-ae8c-3758c5342769 for instance 0ae1a222-b48a-4e85-8c65-5d3dccd56f1e on hv-cinder-83538 Aug 31 19:20:14.563577 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-f4ba2dfa-25f3-4c84-bb29-937ce3f8d8d0 req-d15ab978-eaa9-4805-9128-8dea89981bd8 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031596 Aug 31 19:20:14.564161 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 419/844] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:20:15.150554 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-946be785-2253-41dc-8f83-25bcfeeb5e6a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:15.151562 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-946be785-2253-41dc-8f83-25bcfeeb5e6a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: 0ae1a222-b48a-4e85-8c65-5d3dccd56f1e] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:15.158057 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-946be785-2253-41dc-8f83-25bcfeeb5e6a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:15.158544 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-946be785-2253-41dc-8f83-25bcfeeb5e6a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:15.158974 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-946be785-2253-41dc-8f83-25bcfeeb5e6a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:15.159660 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-946be785-2253-41dc-8f83-25bcfeeb5e6a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:15.160106 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-946be785-2253-41dc-8f83-25bcfeeb5e6a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:15.160536 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-946be785-2253-41dc-8f83-25bcfeeb5e6a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:15.293653 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-946be785-2253-41dc-8f83-25bcfeeb5e6a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:15.301732 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-946be785-2253-41dc-8f83-25bcfeeb5e6a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/0ae1a222-b48a-4e85-8c65-5d3dccd56f1e" status: 200 len: 1365 microversion: 2.1 time: 0.155337 Aug 31 19:20:15.302296 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 426/845] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:15 2022] GET /compute/v2.1/servers/0ae1a222-b48a-4e85-8c65-5d3dccd56f1e => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:16.320087 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell0:SELECT=2 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:16.324986 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-f1c3b746-1284-4ebc-a54e-3847c6a34a2b tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:16.325712 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-f1c3b746-1284-4ebc-a54e-3847c6a34a2b tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: 0ae1a222-b48a-4e85-8c65-5d3dccd56f1e] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:16.332109 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f1c3b746-1284-4ebc-a54e-3847c6a34a2b tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:16.332587 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f1c3b746-1284-4ebc-a54e-3847c6a34a2b tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:16.333019 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f1c3b746-1284-4ebc-a54e-3847c6a34a2b tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:16.333734 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f1c3b746-1284-4ebc-a54e-3847c6a34a2b tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:16.334189 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f1c3b746-1284-4ebc-a54e-3847c6a34a2b tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:16.334611 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f1c3b746-1284-4ebc-a54e-3847c6a34a2b tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:16.462080 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-f1c3b746-1284-4ebc-a54e-3847c6a34a2b tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:16.469750 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-f1c3b746-1284-4ebc-a54e-3847c6a34a2b tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/0ae1a222-b48a-4e85-8c65-5d3dccd56f1e" status: 200 len: 1365 microversion: 2.1 time: 0.151119 Aug 31 19:20:16.470313 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 420/846] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:16 2022] GET /compute/v2.1/servers/0ae1a222-b48a-4e85-8c65-5d3dccd56f1e => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:17.490320 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-ccaf2e55-c754-4207-93c6-65edf499fb20 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:17.490931 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-ccaf2e55-c754-4207-93c6-65edf499fb20 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: 0ae1a222-b48a-4e85-8c65-5d3dccd56f1e] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:17.493015 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell0:SELECT=2 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:17.493690 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell0:SELECT=10 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:17.499720 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ccaf2e55-c754-4207-93c6-65edf499fb20 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:17.500199 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ccaf2e55-c754-4207-93c6-65edf499fb20 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:17.500628 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ccaf2e55-c754-4207-93c6-65edf499fb20 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:17.501367 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ccaf2e55-c754-4207-93c6-65edf499fb20 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:17.501816 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ccaf2e55-c754-4207-93c6-65edf499fb20 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:17.502233 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ccaf2e55-c754-4207-93c6-65edf499fb20 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:17.632888 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-ccaf2e55-c754-4207-93c6-65edf499fb20 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:17.641108 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-ccaf2e55-c754-4207-93c6-65edf499fb20 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/0ae1a222-b48a-4e85-8c65-5d3dccd56f1e" status: 200 len: 1554 microversion: 2.1 time: 0.154642 Aug 31 19:20:17.641699 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 427/847] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:17 2022] GET /compute/v2.1/servers/0ae1a222-b48a-4e85-8c65-5d3dccd56f1e => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:17.662174 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-4a571fe1-e6ec-4afd-bc1f-fd4b57464a11 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:17.662734 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-4a571fe1-e6ec-4afd-bc1f-fd4b57464a11 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: 0ae1a222-b48a-4e85-8c65-5d3dccd56f1e] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:17.669179 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4a571fe1-e6ec-4afd-bc1f-fd4b57464a11 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:17.669675 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4a571fe1-e6ec-4afd-bc1f-fd4b57464a11 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:17.670093 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4a571fe1-e6ec-4afd-bc1f-fd4b57464a11 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:17.670769 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4a571fe1-e6ec-4afd-bc1f-fd4b57464a11 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:17.671216 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4a571fe1-e6ec-4afd-bc1f-fd4b57464a11 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:17.671630 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4a571fe1-e6ec-4afd-bc1f-fd4b57464a11 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:17.746585 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-4a571fe1-e6ec-4afd-bc1f-fd4b57464a11 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/0ae1a222-b48a-4e85-8c65-5d3dccd56f1e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088206 Aug 31 19:20:17.747215 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 421/848] 10.222.0.65 () {58 vars in 1275 bytes} [Wed Aug 31 19:20:17 2022] GET /compute/v2.1/servers/0ae1a222-b48a-4e85-8c65-5d3dccd56f1e/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:20:18.881410 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-0d241cf5-9312-4187-8a0a-8f625202c437 req-3ffc0f58-e652-49f1-9bd6-18664954072f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ae1a222-b48a-4e85-8c65-5d3dccd56f1e", "tag": "f8252d75-812c-42e5-ae8c-3758c5342769"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:20:18.892939 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-0d241cf5-9312-4187-8a0a-8f625202c437 req-3ffc0f58-e652-49f1-9bd6-18664954072f service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:18.893780 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-0d241cf5-9312-4187-8a0a-8f625202c437 req-3ffc0f58-e652-49f1-9bd6-18664954072f service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:18.894478 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-0d241cf5-9312-4187-8a0a-8f625202c437 req-3ffc0f58-e652-49f1-9bd6-18664954072f service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:18.906657 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-0d241cf5-9312-4187-8a0a-8f625202c437 req-3ffc0f58-e652-49f1-9bd6-18664954072f service nova] Creating event network-changed:f8252d75-812c-42e5-ae8c-3758c5342769 for instance 0ae1a222-b48a-4e85-8c65-5d3dccd56f1e on hv-cinder-83538 Aug 31 19:20:18.911832 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-0d241cf5-9312-4187-8a0a-8f625202c437 req-3ffc0f58-e652-49f1-9bd6-18664954072f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034198 Aug 31 19:20:18.912686 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 428/849] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:20:43.496074 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=2 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:43.496849 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=13 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:43.501828 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-4ba93b08-5e55-4b5e-9ef1-cfd59baff1e9 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:43.502329 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-4ba93b08-5e55-4b5e-9ef1-cfd59baff1e9 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:43.509387 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4ba93b08-5e55-4b5e-9ef1-cfd59baff1e9 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:43.509873 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4ba93b08-5e55-4b5e-9ef1-cfd59baff1e9 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:43.510308 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4ba93b08-5e55-4b5e-9ef1-cfd59baff1e9 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:43.510997 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4ba93b08-5e55-4b5e-9ef1-cfd59baff1e9 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:43.511455 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4ba93b08-5e55-4b5e-9ef1-cfd59baff1e9 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:43.511880 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4ba93b08-5e55-4b5e-9ef1-cfd59baff1e9 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:43.591349 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.objects.instance [None req-4ba93b08-5e55-4b5e-9ef1-cfd59baff1e9 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lazy-loading 'services' on Instance uuid c81a2adf-d0a7-44b6-abf6-74f03fe93857 {{(pid=120623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:20:43.661911 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-4ba93b08-5e55-4b5e-9ef1-cfd59baff1e9 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "DELETE /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857/os-volume_attachments/32d4d022-6bdd-4cf6-9d9b-f0a1678c3869" status: 202 len: 0 microversion: 2.1 time: 0.167064 Aug 31 19:20:43.662503 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 422/850] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Aug 31 19:20:43 2022] DELETE /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857/os-volume_attachments/32d4d022-6bdd-4cf6-9d9b-f0a1678c3869 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:20:43.672823 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-65d3f472-2276-4210-9c01-1aa3fdb72c5d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:43.675133 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-65d3f472-2276-4210-9c01-1aa3fdb72c5d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:43.678149 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=24 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:43.678969 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=62 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:43.684580 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-65d3f472-2276-4210-9c01-1aa3fdb72c5d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:43.685096 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-65d3f472-2276-4210-9c01-1aa3fdb72c5d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:43.686152 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-65d3f472-2276-4210-9c01-1aa3fdb72c5d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:43.686857 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-65d3f472-2276-4210-9c01-1aa3fdb72c5d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:43.687312 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-65d3f472-2276-4210-9c01-1aa3fdb72c5d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:43.687764 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-65d3f472-2276-4210-9c01-1aa3fdb72c5d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:43.719908 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-65d3f472-2276-4210-9c01-1aa3fdb72c5d tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052689 Aug 31 19:20:43.724932 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 429/851] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 31 19:20:43 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:20:44.733475 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-874a818d-f78d-436b-8dcf-2118e80a0962 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:44.735883 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-874a818d-f78d-436b-8dcf-2118e80a0962 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:44.742165 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-874a818d-f78d-436b-8dcf-2118e80a0962 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:44.742645 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-874a818d-f78d-436b-8dcf-2118e80a0962 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:44.743071 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-874a818d-f78d-436b-8dcf-2118e80a0962 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:44.743753 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-874a818d-f78d-436b-8dcf-2118e80a0962 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:44.744196 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-874a818d-f78d-436b-8dcf-2118e80a0962 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:44.744611 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-874a818d-f78d-436b-8dcf-2118e80a0962 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:44.774853 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-874a818d-f78d-436b-8dcf-2118e80a0962 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046271 Aug 31 19:20:44.775494 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 423/852] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 31 19:20:44 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 19:20:44.853562 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-f5d652fd-cb88-4b72-8b7a-ce2236d26f55 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:44.854139 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-f5d652fd-cb88-4b72-8b7a-ce2236d26f55 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:44.860535 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f5d652fd-cb88-4b72-8b7a-ce2236d26f55 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:44.861016 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f5d652fd-cb88-4b72-8b7a-ce2236d26f55 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:44.861480 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f5d652fd-cb88-4b72-8b7a-ce2236d26f55 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:44.862167 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f5d652fd-cb88-4b72-8b7a-ce2236d26f55 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:44.862617 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f5d652fd-cb88-4b72-8b7a-ce2236d26f55 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:44.863035 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f5d652fd-cb88-4b72-8b7a-ce2236d26f55 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:44.887967 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-f5d652fd-cb88-4b72-8b7a-ce2236d26f55 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Going to try to terminate instance {{(pid=120624) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 19:20:44.959411 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-f5d652fd-cb88-4b72-8b7a-ce2236d26f55 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "DELETE /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 204 len: 0 microversion: 2.1 time: 0.109597 Aug 31 19:20:44.960258 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 430/853] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 31 19:20:44 2022] DELETE /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:20:44.968209 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-184e057f-ed36-46b5-b2ee-13be5afb1e21 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:44.968751 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-184e057f-ed36-46b5-b2ee-13be5afb1e21 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:44.974817 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-184e057f-ed36-46b5-b2ee-13be5afb1e21 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:44.975283 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-184e057f-ed36-46b5-b2ee-13be5afb1e21 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:44.975701 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-184e057f-ed36-46b5-b2ee-13be5afb1e21 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:44.976364 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-184e057f-ed36-46b5-b2ee-13be5afb1e21 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:44.976804 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-184e057f-ed36-46b5-b2ee-13be5afb1e21 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:44.977237 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-184e057f-ed36-46b5-b2ee-13be5afb1e21 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:45.117528 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-184e057f-ed36-46b5-b2ee-13be5afb1e21 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:45.125205 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-184e057f-ed36-46b5-b2ee-13be5afb1e21 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1691 microversion: 2.1 time: 0.160855 Aug 31 19:20:45.125761 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 424/854] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:44 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:46.146590 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-407b8e6d-29cd-464c-bd44-4c66ecee15eb tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:46.147276 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-407b8e6d-29cd-464c-bd44-4c66ecee15eb tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:46.153560 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-407b8e6d-29cd-464c-bd44-4c66ecee15eb tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:46.154586 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-407b8e6d-29cd-464c-bd44-4c66ecee15eb tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:46.155034 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-407b8e6d-29cd-464c-bd44-4c66ecee15eb tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:46.155718 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-407b8e6d-29cd-464c-bd44-4c66ecee15eb tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:46.156188 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-407b8e6d-29cd-464c-bd44-4c66ecee15eb tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:46.156605 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-407b8e6d-29cd-464c-bd44-4c66ecee15eb tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:46.287477 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-407b8e6d-29cd-464c-bd44-4c66ecee15eb tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:46.295200 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-407b8e6d-29cd-464c-bd44-4c66ecee15eb tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1691 microversion: 2.1 time: 0.152899 Aug 31 19:20:46.295772 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 431/855] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:46 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1691 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:47.316217 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-05933cf4-cb70-4ee0-85f0-6a553d8b945c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:47.316820 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-05933cf4-cb70-4ee0-85f0-6a553d8b945c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:47.323268 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-05933cf4-cb70-4ee0-85f0-6a553d8b945c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:47.323743 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-05933cf4-cb70-4ee0-85f0-6a553d8b945c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:47.324170 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-05933cf4-cb70-4ee0-85f0-6a553d8b945c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:47.324845 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-05933cf4-cb70-4ee0-85f0-6a553d8b945c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:47.325368 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-05933cf4-cb70-4ee0-85f0-6a553d8b945c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:47.325828 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-05933cf4-cb70-4ee0-85f0-6a553d8b945c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:47.452731 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-05933cf4-cb70-4ee0-85f0-6a553d8b945c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:47.460288 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-05933cf4-cb70-4ee0-85f0-6a553d8b945c tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1691 microversion: 2.1 time: 0.147974 Aug 31 19:20:47.460840 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 425/856] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:47 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1691 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:48.481401 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-980d89aa-63fb-4064-8963-aaf87f876b70 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:48.481964 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-980d89aa-63fb-4064-8963-aaf87f876b70 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:48.488599 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-980d89aa-63fb-4064-8963-aaf87f876b70 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:48.489082 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-980d89aa-63fb-4064-8963-aaf87f876b70 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:48.489564 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-980d89aa-63fb-4064-8963-aaf87f876b70 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:48.490263 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-980d89aa-63fb-4064-8963-aaf87f876b70 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:48.490712 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-980d89aa-63fb-4064-8963-aaf87f876b70 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:48.491133 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-980d89aa-63fb-4064-8963-aaf87f876b70 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:48.622283 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-980d89aa-63fb-4064-8963-aaf87f876b70 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:48.630020 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-980d89aa-63fb-4064-8963-aaf87f876b70 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1691 microversion: 2.1 time: 0.152631 Aug 31 19:20:48.630586 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 432/857] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:48 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1691 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:49.650226 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-392c4b30-5a2a-43bc-bdd3-367380ccde6a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:49.650924 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-392c4b30-5a2a-43bc-bdd3-367380ccde6a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:49.658518 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-392c4b30-5a2a-43bc-bdd3-367380ccde6a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:49.659175 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-392c4b30-5a2a-43bc-bdd3-367380ccde6a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:49.659709 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-392c4b30-5a2a-43bc-bdd3-367380ccde6a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:49.660500 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-392c4b30-5a2a-43bc-bdd3-367380ccde6a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:49.661087 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-392c4b30-5a2a-43bc-bdd3-367380ccde6a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:49.661721 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-392c4b30-5a2a-43bc-bdd3-367380ccde6a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:49.751278 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-392c4b30-5a2a-43bc-bdd3-367380ccde6a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:49.759636 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-392c4b30-5a2a-43bc-bdd3-367380ccde6a tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1623 microversion: 2.1 time: 0.113240 Aug 31 19:20:49.760198 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 426/858] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:49 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1623 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:49.830078 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-468c30c2-c55b-4f40-b8a1-3eefceb9f13c req-9f851a41-33bd-41ed-8ffb-d5c6527d2be9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c81a2adf-d0a7-44b6-abf6-74f03fe93857", "name": "network-vif-deleted", "tag": "2ccb095c-a665-47ff-bcff-65a4dc08d119"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:20:49.840645 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-468c30c2-c55b-4f40-b8a1-3eefceb9f13c req-9f851a41-33bd-41ed-8ffb-d5c6527d2be9 service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:49.841258 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-468c30c2-c55b-4f40-b8a1-3eefceb9f13c req-9f851a41-33bd-41ed-8ffb-d5c6527d2be9 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:49.842320 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-468c30c2-c55b-4f40-b8a1-3eefceb9f13c req-9f851a41-33bd-41ed-8ffb-d5c6527d2be9 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:49.855292 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-468c30c2-c55b-4f40-b8a1-3eefceb9f13c req-9f851a41-33bd-41ed-8ffb-d5c6527d2be9 service nova] Creating event network-vif-deleted:2ccb095c-a665-47ff-bcff-65a4dc08d119 for instance c81a2adf-d0a7-44b6-abf6-74f03fe93857 on hv-cinder-83538 Aug 31 19:20:49.863512 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-468c30c2-c55b-4f40-b8a1-3eefceb9f13c req-9f851a41-33bd-41ed-8ffb-d5c6527d2be9 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037741 Aug 31 19:20:49.864374 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 433/859] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:20:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:20:50.781251 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-8c6e3c3c-b08c-4858-b626-c628cccd7cd5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:50.781861 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-8c6e3c3c-b08c-4858-b626-c628cccd7cd5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:50.788614 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8c6e3c3c-b08c-4858-b626-c628cccd7cd5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:50.789103 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8c6e3c3c-b08c-4858-b626-c628cccd7cd5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:50.789560 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8c6e3c3c-b08c-4858-b626-c628cccd7cd5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:50.790254 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8c6e3c3c-b08c-4858-b626-c628cccd7cd5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:50.790708 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8c6e3c3c-b08c-4858-b626-c628cccd7cd5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:50.791129 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8c6e3c3c-b08c-4858-b626-c628cccd7cd5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:50.823896 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8c6e3c3c-b08c-4858-b626-c628cccd7cd5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:50.824387 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8c6e3c3c-b08c-4858-b626-c628cccd7cd5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:50.824822 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8c6e3c3c-b08c-4858-b626-c628cccd7cd5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:50.825401 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.objects.instance [None req-8c6e3c3c-b08c-4858-b626-c628cccd7cd5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lazy-loading 'fault' on Instance uuid c81a2adf-d0a7-44b6-abf6-74f03fe93857 {{(pid=120623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:20:50.869524 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-8c6e3c3c-b08c-4858-b626-c628cccd7cd5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:50.877857 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-8c6e3c3c-b08c-4858-b626-c628cccd7cd5 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 200 len: 1336 microversion: 2.1 time: 0.100595 Aug 31 19:20:50.878440 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 427/860] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:50 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 1336 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:51.902354 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-294aa79d-258b-4c27-ae11-25b9fbb6d0a6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:51.903051 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-294aa79d-258b-4c27-ae11-25b9fbb6d0a6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: c81a2adf-d0a7-44b6-abf6-74f03fe93857] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:51.909976 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-294aa79d-258b-4c27-ae11-25b9fbb6d0a6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:51.910456 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-294aa79d-258b-4c27-ae11-25b9fbb6d0a6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:51.910890 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-294aa79d-258b-4c27-ae11-25b9fbb6d0a6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:51.911677 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-294aa79d-258b-4c27-ae11-25b9fbb6d0a6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:51.912135 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-294aa79d-258b-4c27-ae11-25b9fbb6d0a6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:51.912553 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-294aa79d-258b-4c27-ae11-25b9fbb6d0a6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:51.925723 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.wsgi [None req-294aa79d-258b-4c27-ae11-25b9fbb6d0a6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] HTTP exception thrown: Instance c81a2adf-d0a7-44b6-abf6-74f03fe93857 could not be found. Aug 31 19:20:51.927323 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-294aa79d-258b-4c27-ae11-25b9fbb6d0a6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Request method failure captured: Aug 31 19:20:51.927323 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: request: GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 HTTP/1.1 Aug 31 19:20:51.927323 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept: application/json Aug 31 19:20:51.927323 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Aug 31 19:20:51.927323 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Connection: close Aug 31 19:20:51.927323 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Length: 0 Aug 31 19:20:51.927323 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Type: application/json Aug 31 19:20:51.927323 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Host: 10.222.0.65 Aug 31 19:20:51.927323 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Aug 31 19:20:51.927323 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Aug 31 19:20:51.927323 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjD7KOlBALRYg9399MMb60KjA4ASvzgtL1fbEjfGfYKkQDFDd34Xyka_n4-xuhW1XYCsQfE8u_kNDZeL9oEdunAB6QbQoi_8yNGy9km4X1NZ-R1OWPUKtY-9EToi-YGlRmDnKh4j-19QgSeWbL8e8I_blzc8DpEbhUiI4vF3YAGNOsMLo Aug 31 19:20:51.927323 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Aug 31 19:20:51.927323 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Aug 31 19:20:51.927323 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Aug 31 19:20:51.927323 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Aug 31 19:20:51.927323 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Aug 31 19:20:51.927323 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Aug 31 19:20:51.927323 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Id: e3aa913bb25c45039643ce87bb84cbc2 Aug 31 19:20:51.927323 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-30468556 Aug 31 19:20:51.927323 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Role: member,reader Aug 31 19:20:51.927323 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Roles: member,reader Aug 31 19:20:51.928978 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/e3aa913bb25c45039643ce87bb84cbc2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e3aa913bb25c45039643ce87bb84cbc2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_e3aa913bb25c45039643ce87bb84cbc2", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e3aa913bb25c45039643ce87bb84cbc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:20:51.928978 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-ServerRescueNegativeTestJSON-30468556 Aug 31 19:20:51.928978 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Id: e3aa913bb25c45039643ce87bb84cbc2 Aug 31 19:20:51.928978 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-30468556 Aug 31 19:20:51.928978 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User: tempest-ServerRescueNegativeTestJSON-30468556-project Aug 31 19:20:51.928978 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Aug 31 19:20:51.928978 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Aug 31 19:20:51.928978 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Id: aa81a686e4324370a20e3fc35e5cc7a5 Aug 31 19:20:51.928978 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-ServerRescueNegativeTestJSON-30468556-project Aug 31 19:20:51.928978 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: method: > Aug 31 19:20:51.928978 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: exception: Instance c81a2adf-d0a7-44b6-abf6-74f03fe93857 could not be found. Aug 31 19:20:51.928978 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: action_args: {'id': 'c81a2adf-d0a7-44b6-abf6-74f03fe93857'} Aug 31 19:20:51.929890 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:20:51.929890 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:20:51.929890 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:20:51.929890 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:20:51.929890 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:20:51.929890 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:20:51.929890 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:20:51.929890 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:20:51.929890 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:20:51.929890 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:20:51.929890 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c81a2adf-d0a7-44b6-abf6-74f03fe93857 could not be found. Aug 31 19:20:51.929890 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:20:51.929890 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:20:51.929890 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:20:51.929890 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:20:51.929890 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:20:51.929890 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:20:51.929890 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:20:51.929890 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:20:51.929890 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:20:51.931534 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:20:51.931534 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:20:51.931534 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:20:51.931534 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:20:51.931534 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:20:51.931534 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:20:51.931534 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:20:51.931534 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c81a2adf-d0a7-44b6-abf6-74f03fe93857 could not be found. Aug 31 19:20:51.931534 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:20:51.931534 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:20:51.931534 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:20:51.931534 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:20:51.931534 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:20:51.931534 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:20:51.931534 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:20:51.931534 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:20:51.931534 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c81a2adf-d0a7-44b6-abf6-74f03fe93857 could not be found. Aug 31 19:20:51.931534 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:20:51.933040 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-294aa79d-258b-4c27-ae11-25b9fbb6d0a6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Returning 404 to user: Instance c81a2adf-d0a7-44b6-abf6-74f03fe93857 could not be found. {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:20:51.933040 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-294aa79d-258b-4c27-ae11-25b9fbb6d0a6 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857" status: 404 len: 111 microversion: 2.1 time: 0.031505 Aug 31 19:20:51.933040 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 434/861] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:51 2022] GET /compute/v2.1/servers/c81a2adf-d0a7-44b6-abf6-74f03fe93857 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:20:51.937495 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-30759d71-6645-43f9-befd-34efd6667e21 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '.version_select at 0x7fdb86352c10>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:51.970877 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-30759d71-6645-43f9-befd-34efd6667e21 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1130831647" status: 202 len: 0 microversion: 2.1 time: 0.037267 Aug 31 19:20:51.971460 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 428/862] 10.222.0.65 () {58 vars in 1221 bytes} [Wed Aug 31 19:20:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1130831647 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:20:54.831924 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-0b79f36f-9645-4023-8942-2ecbb26e4934 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:54.832421 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-0b79f36f-9645-4023-8942-2ecbb26e4934 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:54.838897 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0b79f36f-9645-4023-8942-2ecbb26e4934 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:54.839379 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0b79f36f-9645-4023-8942-2ecbb26e4934 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:54.839811 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0b79f36f-9645-4023-8942-2ecbb26e4934 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:54.840500 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0b79f36f-9645-4023-8942-2ecbb26e4934 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:54.840966 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0b79f36f-9645-4023-8942-2ecbb26e4934 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:54.841971 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0b79f36f-9645-4023-8942-2ecbb26e4934 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:54.866732 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-0b79f36f-9645-4023-8942-2ecbb26e4934 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Going to try to terminate instance {{(pid=120624) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 19:20:54.939228 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-0b79f36f-9645-4023-8942-2ecbb26e4934 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "DELETE /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 204 len: 0 microversion: 2.1 time: 0.110826 Aug 31 19:20:54.939809 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 435/863] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 31 19:20:54 2022] DELETE /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:20:54.949522 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-44dad3dc-cb2b-4587-aedc-7f97089eb1bf tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:54.950139 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-44dad3dc-cb2b-4587-aedc-7f97089eb1bf tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:54.957122 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-44dad3dc-cb2b-4587-aedc-7f97089eb1bf tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:54.957658 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-44dad3dc-cb2b-4587-aedc-7f97089eb1bf tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:54.958094 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-44dad3dc-cb2b-4587-aedc-7f97089eb1bf tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:54.958780 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-44dad3dc-cb2b-4587-aedc-7f97089eb1bf tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:54.959232 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-44dad3dc-cb2b-4587-aedc-7f97089eb1bf tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:54.959658 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-44dad3dc-cb2b-4587-aedc-7f97089eb1bf tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:55.084203 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-44dad3dc-cb2b-4587-aedc-7f97089eb1bf tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:55.092652 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-44dad3dc-cb2b-4587-aedc-7f97089eb1bf tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1507 microversion: 2.1 time: 0.147977 Aug 31 19:20:55.093239 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 429/864] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:54 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:56.114706 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-2e981e50-7254-4b77-86a8-43ed246af7ac tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:56.115538 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-2e981e50-7254-4b77-86a8-43ed246af7ac tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:56.121513 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2e981e50-7254-4b77-86a8-43ed246af7ac tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:56.121985 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2e981e50-7254-4b77-86a8-43ed246af7ac tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:56.122901 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2e981e50-7254-4b77-86a8-43ed246af7ac tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:56.123584 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2e981e50-7254-4b77-86a8-43ed246af7ac tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:56.124022 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2e981e50-7254-4b77-86a8-43ed246af7ac tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:56.124432 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2e981e50-7254-4b77-86a8-43ed246af7ac tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:56.267384 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-2e981e50-7254-4b77-86a8-43ed246af7ac tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:56.275160 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-2e981e50-7254-4b77-86a8-43ed246af7ac tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 200 len: 1507 microversion: 2.1 time: 0.164627 Aug 31 19:20:56.275730 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 436/865] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:56 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 1507 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:56.479716 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-02dbf552-56a0-4705-b749-fbd9aa2f4ae9 req-8c8b49be-f256-438c-8764-b7f44dd2fbee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88b9d0d7-01c7-4a08-9a15-a20bd1db6019", "name": "network-vif-deleted", "tag": "1822743f-00a6-44c7-b33e-1c7130689b42"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:20:56.491868 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-02dbf552-56a0-4705-b749-fbd9aa2f4ae9 req-8c8b49be-f256-438c-8764-b7f44dd2fbee service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:56.492467 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-02dbf552-56a0-4705-b749-fbd9aa2f4ae9 req-8c8b49be-f256-438c-8764-b7f44dd2fbee service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:56.492962 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-02dbf552-56a0-4705-b749-fbd9aa2f4ae9 req-8c8b49be-f256-438c-8764-b7f44dd2fbee service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:56.505857 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-02dbf552-56a0-4705-b749-fbd9aa2f4ae9 req-8c8b49be-f256-438c-8764-b7f44dd2fbee service nova] Creating event network-vif-deleted:1822743f-00a6-44c7-b33e-1c7130689b42 for instance 88b9d0d7-01c7-4a08-9a15-a20bd1db6019 on hv-cinder-83538 Aug 31 19:20:56.513982 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-02dbf552-56a0-4705-b749-fbd9aa2f4ae9 req-8c8b49be-f256-438c-8764-b7f44dd2fbee service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038201 Aug 31 19:20:56.514583 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 430/866] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:20:57.296612 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-51c97f2f-9819-4de5-acac-57673f899d4e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:57.297459 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-51c97f2f-9819-4de5-acac-57673f899d4e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 88b9d0d7-01c7-4a08-9a15-a20bd1db6019] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:57.303658 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-51c97f2f-9819-4de5-acac-57673f899d4e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:57.304139 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-51c97f2f-9819-4de5-acac-57673f899d4e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:57.304572 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-51c97f2f-9819-4de5-acac-57673f899d4e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:57.305320 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-51c97f2f-9819-4de5-acac-57673f899d4e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:57.305772 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-51c97f2f-9819-4de5-acac-57673f899d4e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:57.306192 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-51c97f2f-9819-4de5-acac-57673f899d4e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:57.320035 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.wsgi [None req-51c97f2f-9819-4de5-acac-57673f899d4e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] HTTP exception thrown: Instance 88b9d0d7-01c7-4a08-9a15-a20bd1db6019 could not be found. Aug 31 19:20:57.321601 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-51c97f2f-9819-4de5-acac-57673f899d4e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Request method failure captured: Aug 31 19:20:57.321601 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: request: GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 HTTP/1.1 Aug 31 19:20:57.321601 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept: application/json Aug 31 19:20:57.321601 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Aug 31 19:20:57.321601 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Connection: close Aug 31 19:20:57.321601 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Length: 0 Aug 31 19:20:57.321601 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Type: application/json Aug 31 19:20:57.321601 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Host: 10.222.0.65 Aug 31 19:20:57.321601 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Aug 31 19:20:57.321601 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Aug 31 19:20:57.321601 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjD7KOlBALRYg9399MMb60KjA4ASvzgtL1fbEjfGfYKkQDFDd34Xyka_n4-xuhW1XYCsQfE8u_kNDZeL9oEdunAB6QbQoi_8yNGy9km4X1NZ-R1OWPUKtY-9EToi-YGlRmDnKh4j-19QgSeWbL8e8I_blzc8DpEbhUiI4vF3YAGNOsMLo Aug 31 19:20:57.321601 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Aug 31 19:20:57.321601 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Aug 31 19:20:57.321601 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Aug 31 19:20:57.321601 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Aug 31 19:20:57.321601 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Aug 31 19:20:57.321601 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Aug 31 19:20:57.321601 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Id: e3aa913bb25c45039643ce87bb84cbc2 Aug 31 19:20:57.321601 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-30468556 Aug 31 19:20:57.321601 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Role: member,reader Aug 31 19:20:57.321601 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Roles: member,reader Aug 31 19:20:57.323059 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/e3aa913bb25c45039643ce87bb84cbc2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e3aa913bb25c45039643ce87bb84cbc2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_e3aa913bb25c45039643ce87bb84cbc2", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e3aa913bb25c45039643ce87bb84cbc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:20:57.323059 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-ServerRescueNegativeTestJSON-30468556 Aug 31 19:20:57.323059 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Id: e3aa913bb25c45039643ce87bb84cbc2 Aug 31 19:20:57.323059 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-30468556 Aug 31 19:20:57.323059 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User: tempest-ServerRescueNegativeTestJSON-30468556-project Aug 31 19:20:57.323059 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Aug 31 19:20:57.323059 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Aug 31 19:20:57.323059 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Id: aa81a686e4324370a20e3fc35e5cc7a5 Aug 31 19:20:57.323059 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-ServerRescueNegativeTestJSON-30468556-project Aug 31 19:20:57.323059 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: method: > Aug 31 19:20:57.323059 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: exception: Instance 88b9d0d7-01c7-4a08-9a15-a20bd1db6019 could not be found. Aug 31 19:20:57.323059 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: action_args: {'id': '88b9d0d7-01c7-4a08-9a15-a20bd1db6019'} Aug 31 19:20:57.323834 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:20:57.323834 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:20:57.323834 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:20:57.323834 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:20:57.323834 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:20:57.323834 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:20:57.323834 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:20:57.323834 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:20:57.323834 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:20:57.323834 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:20:57.323834 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88b9d0d7-01c7-4a08-9a15-a20bd1db6019 could not be found. Aug 31 19:20:57.323834 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:20:57.323834 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:20:57.323834 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:20:57.323834 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:20:57.323834 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:20:57.323834 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:20:57.323834 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:20:57.323834 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:20:57.323834 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:20:57.324998 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:20:57.324998 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:20:57.324998 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:20:57.324998 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:20:57.324998 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:20:57.324998 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:20:57.324998 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:20:57.324998 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88b9d0d7-01c7-4a08-9a15-a20bd1db6019 could not be found. Aug 31 19:20:57.324998 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:20:57.324998 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:20:57.324998 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:20:57.324998 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:20:57.324998 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:20:57.324998 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:20:57.324998 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:20:57.324998 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:20:57.324998 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88b9d0d7-01c7-4a08-9a15-a20bd1db6019 could not be found. Aug 31 19:20:57.324998 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:20:57.326113 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-51c97f2f-9819-4de5-acac-57673f899d4e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Returning 404 to user: Instance 88b9d0d7-01c7-4a08-9a15-a20bd1db6019 could not be found. {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:20:57.326113 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-51c97f2f-9819-4de5-acac-57673f899d4e tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019" status: 404 len: 111 microversion: 2.1 time: 0.030854 Aug 31 19:20:57.326113 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 437/867] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:57 2022] GET /compute/v2.1/servers/88b9d0d7-01c7-4a08-9a15-a20bd1db6019 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:20:57.332365 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-02e563a0-0157-4a5f-a22e-f3a84e8b2259 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:57.332979 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-02e563a0-0157-4a5f-a22e-f3a84e8b2259 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:57.339221 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-02e563a0-0157-4a5f-a22e-f3a84e8b2259 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:57.339718 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-02e563a0-0157-4a5f-a22e-f3a84e8b2259 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:57.340132 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-02e563a0-0157-4a5f-a22e-f3a84e8b2259 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:57.340812 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-02e563a0-0157-4a5f-a22e-f3a84e8b2259 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:57.341802 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-02e563a0-0157-4a5f-a22e-f3a84e8b2259 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:57.342229 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-02e563a0-0157-4a5f-a22e-f3a84e8b2259 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:57.367517 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-02e563a0-0157-4a5f-a22e-f3a84e8b2259 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48] Going to try to terminate instance {{(pid=120623) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 19:20:57.438495 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-02e563a0-0157-4a5f-a22e-f3a84e8b2259 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "DELETE /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48" status: 204 len: 0 microversion: 2.1 time: 0.110018 Aug 31 19:20:57.439137 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 431/868] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 31 19:20:57 2022] DELETE /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:20:57.448825 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-b94bb392-4f36-410c-8403-07e462172fcf tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:57.449470 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-b94bb392-4f36-410c-8403-07e462172fcf tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:57.455443 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b94bb392-4f36-410c-8403-07e462172fcf tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:57.455927 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b94bb392-4f36-410c-8403-07e462172fcf tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:57.456357 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b94bb392-4f36-410c-8403-07e462172fcf tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:57.457042 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b94bb392-4f36-410c-8403-07e462172fcf tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:57.457521 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b94bb392-4f36-410c-8403-07e462172fcf tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:57.457945 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b94bb392-4f36-410c-8403-07e462172fcf tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:57.587769 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-b94bb392-4f36-410c-8403-07e462172fcf tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:57.596139 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-b94bb392-4f36-410c-8403-07e462172fcf tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48" status: 200 len: 1521 microversion: 2.1 time: 0.152467 Aug 31 19:20:57.596714 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 438/869] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:57 2022] GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:58.618694 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-bdee2e31-6930-49e9-a7fe-5c5e9b9b7447 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:58.619399 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-bdee2e31-6930-49e9-a7fe-5c5e9b9b7447 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:58.625909 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bdee2e31-6930-49e9-a7fe-5c5e9b9b7447 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:58.626397 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bdee2e31-6930-49e9-a7fe-5c5e9b9b7447 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:58.626858 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bdee2e31-6930-49e9-a7fe-5c5e9b9b7447 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:58.627551 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bdee2e31-6930-49e9-a7fe-5c5e9b9b7447 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:58.627996 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bdee2e31-6930-49e9-a7fe-5c5e9b9b7447 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:58.628411 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bdee2e31-6930-49e9-a7fe-5c5e9b9b7447 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:58.822386 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-bdee2e31-6930-49e9-a7fe-5c5e9b9b7447 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa81a686e4324370a20e3fc35e5cc7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3aa913bb25c45039643ce87bb84cbc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:58.830803 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-bdee2e31-6930-49e9-a7fe-5c5e9b9b7447 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48" status: 200 len: 1521 microversion: 2.1 time: 0.216743 Aug 31 19:20:58.831481 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 432/870] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:58 2022] GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:58.932785 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-6c6205d4-920d-41e6-8d66-fb28c5473593 req-f6639a8c-b6db-4032-bb13-b590168d9214 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28005e59-28f2-4e1e-a7d0-4ef68d9d6f48", "name": "network-vif-deleted", "tag": "557704c0-c724-41a1-ae68-ae0c2d6b6bfd"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:20:58.943325 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-6c6205d4-920d-41e6-8d66-fb28c5473593 req-f6639a8c-b6db-4032-bb13-b590168d9214 service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:58.943799 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-6c6205d4-920d-41e6-8d66-fb28c5473593 req-f6639a8c-b6db-4032-bb13-b590168d9214 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:58.944223 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-6c6205d4-920d-41e6-8d66-fb28c5473593 req-f6639a8c-b6db-4032-bb13-b590168d9214 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:58.957312 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-6c6205d4-920d-41e6-8d66-fb28c5473593 req-f6639a8c-b6db-4032-bb13-b590168d9214 service nova] Creating event network-vif-deleted:557704c0-c724-41a1-ae68-ae0c2d6b6bfd for instance 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 on hv-cinder-83538 Aug 31 19:20:58.962034 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-6c6205d4-920d-41e6-8d66-fb28c5473593 req-f6639a8c-b6db-4032-bb13-b590168d9214 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033021 Aug 31 19:20:58.962626 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 439/871] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:20:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:20:59.852160 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-ce40a58f-5acc-44a0-b190-fe93c5a4e089 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:59.852766 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-ce40a58f-5acc-44a0-b190-fe93c5a4e089 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] [instance: 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:59.859146 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ce40a58f-5acc-44a0-b190-fe93c5a4e089 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:59.859651 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ce40a58f-5acc-44a0-b190-fe93c5a4e089 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:59.860082 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ce40a58f-5acc-44a0-b190-fe93c5a4e089 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:59.860786 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ce40a58f-5acc-44a0-b190-fe93c5a4e089 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:59.861260 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ce40a58f-5acc-44a0-b190-fe93c5a4e089 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:59.861680 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ce40a58f-5acc-44a0-b190-fe93c5a4e089 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:59.875248 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.wsgi [None req-ce40a58f-5acc-44a0-b190-fe93c5a4e089 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] HTTP exception thrown: Instance 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 could not be found. Aug 31 19:20:59.876776 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-ce40a58f-5acc-44a0-b190-fe93c5a4e089 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Request method failure captured: Aug 31 19:20:59.876776 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: request: GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 HTTP/1.1 Aug 31 19:20:59.876776 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Accept: application/json Aug 31 19:20:59.876776 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Accept-Encoding: identity Aug 31 19:20:59.876776 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Connection: close Aug 31 19:20:59.876776 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Content-Length: 0 Aug 31 19:20:59.876776 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Content-Type: application/json Aug 31 19:20:59.876776 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Host: 10.222.0.65 Aug 31 19:20:59.876776 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Openstack-System-Scope: None Aug 31 19:20:59.876776 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: User-Agent: python-urllib3/1.26.12 Aug 31 19:20:59.876776 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Auth-Token: gAAAAABjD7KOlBALRYg9399MMb60KjA4ASvzgtL1fbEjfGfYKkQDFDd34Xyka_n4-xuhW1XYCsQfE8u_kNDZeL9oEdunAB6QbQoi_8yNGy9km4X1NZ-R1OWPUKtY-9EToi-YGlRmDnKh4j-19QgSeWbL8e8I_blzc8DpEbhUiI4vF3YAGNOsMLo Aug 31 19:20:59.876776 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Domain-Id: None Aug 31 19:20:59.876776 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Domain-Name: None Aug 31 19:20:59.876776 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Identity-Status: Confirmed Aug 31 19:20:59.876776 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Is-Admin-Project: True Aug 31 19:20:59.876776 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Id: default Aug 31 19:20:59.876776 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Name: Default Aug 31 19:20:59.876776 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Id: e3aa913bb25c45039643ce87bb84cbc2 Aug 31 19:20:59.876776 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-30468556 Aug 31 19:20:59.876776 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Role: member,reader Aug 31 19:20:59.876776 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Roles: member,reader Aug 31 19:20:59.878369 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/e3aa913bb25c45039643ce87bb84cbc2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e3aa913bb25c45039643ce87bb84cbc2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_e3aa913bb25c45039643ce87bb84cbc2", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e3aa913bb25c45039643ce87bb84cbc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:20:59.878369 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant: tempest-ServerRescueNegativeTestJSON-30468556 Aug 31 19:20:59.878369 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant-Id: e3aa913bb25c45039643ce87bb84cbc2 Aug 31 19:20:59.878369 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-30468556 Aug 31 19:20:59.878369 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User: tempest-ServerRescueNegativeTestJSON-30468556-project Aug 31 19:20:59.878369 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Id: default Aug 31 19:20:59.878369 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Name: Default Aug 31 19:20:59.878369 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Id: aa81a686e4324370a20e3fc35e5cc7a5 Aug 31 19:20:59.878369 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Name: tempest-ServerRescueNegativeTestJSON-30468556-project Aug 31 19:20:59.878369 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: method: > Aug 31 19:20:59.878369 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: exception: Instance 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 could not be found. Aug 31 19:20:59.878369 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: action_args: {'id': '28005e59-28f2-4e1e-a7d0-4ef68d9d6f48'} Aug 31 19:20:59.879245 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:20:59.879245 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:20:59.879245 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:20:59.879245 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:20:59.879245 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:20:59.879245 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:20:59.879245 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:20:59.879245 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:20:59.879245 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:20:59.879245 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:20:59.879245 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 could not be found. Aug 31 19:20:59.879245 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:20:59.879245 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:20:59.879245 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:20:59.879245 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:20:59.879245 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:20:59.879245 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:20:59.879245 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:20:59.879245 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:20:59.879245 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:20:59.880592 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:20:59.880592 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:20:59.880592 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:20:59.880592 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:20:59.880592 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:20:59.880592 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:20:59.880592 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:20:59.880592 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 could not be found. Aug 31 19:20:59.880592 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:20:59.880592 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:20:59.880592 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:20:59.880592 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:20:59.880592 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:20:59.880592 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:20:59.880592 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:20:59.880592 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:20:59.880592 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 could not be found. Aug 31 19:20:59.880592 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:20:59.882210 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-ce40a58f-5acc-44a0-b190-fe93c5a4e089 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] Returning 404 to user: Instance 28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 could not be found. {{(pid=120623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:20:59.882210 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-ce40a58f-5acc-44a0-b190-fe93c5a4e089 tempest-ServerRescueNegativeTestJSON-30468556 tempest-ServerRescueNegativeTestJSON-30468556-project] 10.222.0.65 "GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48" status: 404 len: 111 microversion: 2.1 time: 0.030141 Aug 31 19:20:59.882210 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 433/872] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:59 2022] GET /compute/v2.1/servers/28005e59-28f2-4e1e-a7d0-4ef68d9d6f48 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 19:21:01.733662 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-dfa13f63-d9e6-4051-9f7b-8c68bf74b223 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1059620827"}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:21:01.734886 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-dfa13f63-d9e6-4051-9f7b-8c68bf74b223 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] [instance: 5537ff84-8f70-4ba6-b219-09ffa1164d9a] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:01.742052 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dfa13f63-d9e6-4051-9f7b-8c68bf74b223 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:01.742533 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dfa13f63-d9e6-4051-9f7b-8c68bf74b223 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:01.742956 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dfa13f63-d9e6-4051-9f7b-8c68bf74b223 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:01.743640 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dfa13f63-d9e6-4051-9f7b-8c68bf74b223 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:01.744080 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dfa13f63-d9e6-4051-9f7b-8c68bf74b223 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:01.744488 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dfa13f63-d9e6-4051-9f7b-8c68bf74b223 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:01.980596 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.network.security_group_api [None req-dfa13f63-d9e6-4051-9f7b-8c68bf74b223 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Removing security group 292be38d-f81e-48ff-bef3-84dddc1a49db from port ac12d0b7-5798-4d48-8cb0-9040f44c18b1 Aug 31 19:21:02.516696 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-dfa13f63-d9e6-4051-9f7b-8c68bf74b223 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] 10.222.0.65 "POST /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a/action" status: 202 len: 0 microversion: 2.1 time: 0.788473 Aug 31 19:21:02.517841 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 440/873] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 31 19:21:01 2022] POST /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a/action => generated 0 bytes in 790 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 19:21:02.544583 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-b1a69567-1f50-45d1-aedb-f6c283ca0e31 req-5e71fdeb-29b4-4e33-b19e-032070e8515c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5537ff84-8f70-4ba6-b219-09ffa1164d9a", "tag": "ac12d0b7-5798-4d48-8cb0-9040f44c18b1"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:21:02.567353 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-b1a69567-1f50-45d1-aedb-f6c283ca0e31 req-5e71fdeb-29b4-4e33-b19e-032070e8515c service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:02.570885 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-b1a69567-1f50-45d1-aedb-f6c283ca0e31 req-5e71fdeb-29b4-4e33-b19e-032070e8515c service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:02.572922 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-b1a69567-1f50-45d1-aedb-f6c283ca0e31 req-5e71fdeb-29b4-4e33-b19e-032070e8515c service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:02.614513 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-b1a69567-1f50-45d1-aedb-f6c283ca0e31 req-5e71fdeb-29b4-4e33-b19e-032070e8515c service nova] Creating event network-changed:ac12d0b7-5798-4d48-8cb0-9040f44c18b1 for instance 5537ff84-8f70-4ba6-b219-09ffa1164d9a on hv-cinder-83538 Aug 31 19:21:02.622020 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-b1a69567-1f50-45d1-aedb-f6c283ca0e31 req-5e71fdeb-29b4-4e33-b19e-032070e8515c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094162 Aug 31 19:21:02.624007 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 434/874] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:21:04.379580 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-e8c436f8-445e-4dff-be79-9bfc156adc79 req-6537be93-4ff6-4890-9c6c-3ec335ebaebb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5537ff84-8f70-4ba6-b219-09ffa1164d9a", "tag": "ac12d0b7-5798-4d48-8cb0-9040f44c18b1"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:21:04.380513 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-44ff7c4c-bec9-4911-9f74-f548f742312c tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:04.381738 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-44ff7c4c-bec9-4911-9f74-f548f742312c tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] [instance: 5537ff84-8f70-4ba6-b219-09ffa1164d9a] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:04.389828 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-44ff7c4c-bec9-4911-9f74-f548f742312c tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:04.390589 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-44ff7c4c-bec9-4911-9f74-f548f742312c tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:04.391193 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-44ff7c4c-bec9-4911-9f74-f548f742312c tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:04.391895 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-44ff7c4c-bec9-4911-9f74-f548f742312c tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:04.392345 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-44ff7c4c-bec9-4911-9f74-f548f742312c tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:04.392818 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-44ff7c4c-bec9-4911-9f74-f548f742312c tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:04.395126 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-e8c436f8-445e-4dff-be79-9bfc156adc79 req-6537be93-4ff6-4890-9c6c-3ec335ebaebb service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:04.395693 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-e8c436f8-445e-4dff-be79-9bfc156adc79 req-6537be93-4ff6-4890-9c6c-3ec335ebaebb service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:04.396159 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-e8c436f8-445e-4dff-be79-9bfc156adc79 req-6537be93-4ff6-4890-9c6c-3ec335ebaebb service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:04.411974 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-e8c436f8-445e-4dff-be79-9bfc156adc79 req-6537be93-4ff6-4890-9c6c-3ec335ebaebb service nova] Creating event network-changed:ac12d0b7-5798-4d48-8cb0-9040f44c18b1 for instance 5537ff84-8f70-4ba6-b219-09ffa1164d9a on hv-cinder-83538 Aug 31 19:21:04.417791 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-e8c436f8-445e-4dff-be79-9bfc156adc79 req-6537be93-4ff6-4890-9c6c-3ec335ebaebb service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042787 Aug 31 19:21:04.419901 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 435/875] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:21:04.561089 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.objects.instance [None req-44ff7c4c-bec9-4911-9f74-f548f742312c tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lazy-loading 'services' on Instance uuid 5537ff84-8f70-4ba6-b219-09ffa1164d9a {{(pid=120624) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:21:04.699620 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-44ff7c4c-bec9-4911-9f74-f548f742312c tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] 10.222.0.65 "DELETE /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a/os-volume_attachments/12c985f7-d940-466c-8b3e-dd3caabfc3b0" status: 202 len: 0 microversion: 2.1 time: 0.325168 Aug 31 19:21:04.701780 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 441/876] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Aug 31 19:21:04 2022] DELETE /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a/os-volume_attachments/12c985f7-d940-466c-8b3e-dd3caabfc3b0 => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:21:04.710863 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-ee76772f-5646-4830-9b52-3f855cf4ab79 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:04.713558 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-ee76772f-5646-4830-9b52-3f855cf4ab79 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] [instance: 5537ff84-8f70-4ba6-b219-09ffa1164d9a] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:04.729564 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ee76772f-5646-4830-9b52-3f855cf4ab79 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:04.730854 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ee76772f-5646-4830-9b52-3f855cf4ab79 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:04.732155 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ee76772f-5646-4830-9b52-3f855cf4ab79 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:04.733227 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ee76772f-5646-4830-9b52-3f855cf4ab79 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:04.733939 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ee76772f-5646-4830-9b52-3f855cf4ab79 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:04.734190 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ee76772f-5646-4830-9b52-3f855cf4ab79 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:04.803611 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-ee76772f-5646-4830-9b52-3f855cf4ab79 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] 10.222.0.65 "GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097144 Aug 31 19:21:04.805223 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 436/877] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 31 19:21:04 2022] GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:21:05.818305 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-67385245-2a93-44ee-8f09-cb0c2aa3d1bc tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:05.820758 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-67385245-2a93-44ee-8f09-cb0c2aa3d1bc tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] [instance: 5537ff84-8f70-4ba6-b219-09ffa1164d9a] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:05.828735 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-67385245-2a93-44ee-8f09-cb0c2aa3d1bc tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:05.829324 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-67385245-2a93-44ee-8f09-cb0c2aa3d1bc tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:05.829849 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-67385245-2a93-44ee-8f09-cb0c2aa3d1bc tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:05.830548 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-67385245-2a93-44ee-8f09-cb0c2aa3d1bc tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:05.830997 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-67385245-2a93-44ee-8f09-cb0c2aa3d1bc tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:05.831414 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-67385245-2a93-44ee-8f09-cb0c2aa3d1bc tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:05.860838 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-67385245-2a93-44ee-8f09-cb0c2aa3d1bc tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] 10.222.0.65 "GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047558 Aug 31 19:21:05.861427 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 442/878] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 31 19:21:05 2022] GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 19:21:05.871722 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d6f7bbca-b834-435c-9e33-005d4ac2100b tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:05.872309 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d6f7bbca-b834-435c-9e33-005d4ac2100b tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] [instance: 5537ff84-8f70-4ba6-b219-09ffa1164d9a] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:05.878862 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d6f7bbca-b834-435c-9e33-005d4ac2100b tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:05.879356 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d6f7bbca-b834-435c-9e33-005d4ac2100b tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:05.879779 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d6f7bbca-b834-435c-9e33-005d4ac2100b tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:05.880478 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d6f7bbca-b834-435c-9e33-005d4ac2100b tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:05.880930 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d6f7bbca-b834-435c-9e33-005d4ac2100b tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:05.881391 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d6f7bbca-b834-435c-9e33-005d4ac2100b tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:05.956872 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.wsgi [None req-d6f7bbca-b834-435c-9e33-005d4ac2100b tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] HTTP exception thrown: Instance 5537ff84-8f70-4ba6-b219-09ffa1164d9a is not attached to volume 12c985f7-d940-466c-8b3e-dd3caabfc3b0 Aug 31 19:21:05.959283 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d6f7bbca-b834-435c-9e33-005d4ac2100b tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Request method failure captured: Aug 31 19:21:05.959283 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: request: DELETE /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a/os-volume_attachments/12c985f7-d940-466c-8b3e-dd3caabfc3b0 HTTP/1.1 Aug 31 19:21:05.959283 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Accept: application/json Aug 31 19:21:05.959283 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Accept-Encoding: identity Aug 31 19:21:05.959283 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Connection: close Aug 31 19:21:05.959283 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Content-Length: 0 Aug 31 19:21:05.959283 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Content-Type: application/json Aug 31 19:21:05.959283 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Host: 10.222.0.65 Aug 31 19:21:05.959283 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Openstack-System-Scope: None Aug 31 19:21:05.959283 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: User-Agent: python-urllib3/1.26.12 Aug 31 19:21:05.959283 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Auth-Token: gAAAAABjD7OGsfPeT-WgFEGLEucf_LE5sPeG-Ih2yAWIsJDHF6yidXjRTIjfOFLG7mntE0n0sO1kKGvhtMHRqjUsH5pVfI__zzeljRP8zyC1UKBOALdp18cnTK8WtwhqP29fUZAQ5lrG97cZRHQ0Tr0UvztHzCoFTEQR-qa-LUBK1k_ymuvtylk Aug 31 19:21:05.959283 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Domain-Id: None Aug 31 19:21:05.959283 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Domain-Name: None Aug 31 19:21:05.959283 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Identity-Status: Confirmed Aug 31 19:21:05.959283 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Is-Admin-Project: True Aug 31 19:21:05.959283 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Id: default Aug 31 19:21:05.959283 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Name: Default Aug 31 19:21:05.959283 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Id: fe8ee0bdd09b45599a7c19798660aac0 Aug 31 19:21:05.959283 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Name: tempest-TestMinimumBasicScenario-413304632 Aug 31 19:21:05.959283 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Role: member,reader Aug 31 19:21:05.959283 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Roles: member,reader Aug 31 19:21:05.960776 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/fe8ee0bdd09b45599a7c19798660aac0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/fe8ee0bdd09b45599a7c19798660aac0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_fe8ee0bdd09b45599a7c19798660aac0", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/fe8ee0bdd09b45599a7c19798660aac0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:21:05.960776 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant: tempest-TestMinimumBasicScenario-413304632 Aug 31 19:21:05.960776 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant-Id: fe8ee0bdd09b45599a7c19798660aac0 Aug 31 19:21:05.960776 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant-Name: tempest-TestMinimumBasicScenario-413304632 Aug 31 19:21:05.960776 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User: tempest-TestMinimumBasicScenario-413304632-project Aug 31 19:21:05.960776 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Id: default Aug 31 19:21:05.960776 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Name: Default Aug 31 19:21:05.960776 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Id: a07fb9a216ac4683852fc6cae7c10b99 Aug 31 19:21:05.960776 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Name: tempest-TestMinimumBasicScenario-413304632-project Aug 31 19:21:05.960776 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: method: > Aug 31 19:21:05.960776 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: exception: Instance 5537ff84-8f70-4ba6-b219-09ffa1164d9a is not attached to volume 12c985f7-d940-466c-8b3e-dd3caabfc3b0 Aug 31 19:21:05.961568 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: action_args: {'server_id': '5537ff84-8f70-4ba6-b219-09ffa1164d9a', 'id': '12c985f7-d940-466c-8b3e-dd3caabfc3b0'} Aug 31 19:21:05.961568 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:21:05.961568 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:21:05.961568 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 31 19:21:05.961568 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 31 19:21:05.961568 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 19:21:05.961568 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 19:21:05.961568 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 31 19:21:05.961568 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 31 19:21:05.961568 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 12c985f7-d940-466c-8b3e-dd3caabfc3b0. Aug 31 19:21:05.961568 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:21:05.961568 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:21:05.961568 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:21:05.961568 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:21:05.961568 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:21:05.961568 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:21:05.961568 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:21:05.961568 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:21:05.961568 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:21:05.962786 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:21:05.962786 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 31 19:21:05.962786 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 31 19:21:05.962786 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5537ff84-8f70-4ba6-b219-09ffa1164d9a is not attached to volume 12c985f7-d940-466c-8b3e-dd3caabfc3b0 Aug 31 19:21:05.962786 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:21:05.962786 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:21:05.962786 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:21:05.962786 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:21:05.962786 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:21:05.962786 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:21:05.962786 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:21:05.962786 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:21:05.962786 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5537ff84-8f70-4ba6-b219-09ffa1164d9a is not attached to volume 12c985f7-d940-466c-8b3e-dd3caabfc3b0 Aug 31 19:21:05.962786 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:21:05.962786 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d6f7bbca-b834-435c-9e33-005d4ac2100b tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Returning 404 to user: Instance 5537ff84-8f70-4ba6-b219-09ffa1164d9a is not attached to volume 12c985f7-d940-466c-8b3e-dd3caabfc3b0 {{(pid=120623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:21:05.963713 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-d6f7bbca-b834-435c-9e33-005d4ac2100b tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] 10.222.0.65 "DELETE /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a/os-volume_attachments/12c985f7-d940-466c-8b3e-dd3caabfc3b0" status: 404 len: 154 microversion: 2.1 time: 0.092958 Aug 31 19:21:05.963713 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 437/879] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Aug 31 19:21:05 2022] DELETE /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a/os-volume_attachments/12c985f7-d940-466c-8b3e-dd3caabfc3b0 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 19:21:07.107342 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-ec814f22-7e07-4e47-a778-1121881ac852 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:07.107952 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-ec814f22-7e07-4e47-a778-1121881ac852 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] [instance: 5537ff84-8f70-4ba6-b219-09ffa1164d9a] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:07.116060 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ec814f22-7e07-4e47-a778-1121881ac852 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:07.116656 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ec814f22-7e07-4e47-a778-1121881ac852 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:07.117159 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ec814f22-7e07-4e47-a778-1121881ac852 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:07.117958 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ec814f22-7e07-4e47-a778-1121881ac852 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:07.119016 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ec814f22-7e07-4e47-a778-1121881ac852 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:07.119433 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ec814f22-7e07-4e47-a778-1121881ac852 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:07.152450 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-ec814f22-7e07-4e47-a778-1121881ac852 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] [instance: 5537ff84-8f70-4ba6-b219-09ffa1164d9a] Going to try to terminate instance {{(pid=120624) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 19:21:07.181088 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:07.235935 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-ec814f22-7e07-4e47-a778-1121881ac852 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] 10.222.0.65 "DELETE /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a" status: 204 len: 0 microversion: 2.1 time: 0.133542 Aug 31 19:21:07.236935 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 443/880] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 31 19:21:07 2022] DELETE /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:21:07.245256 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-3368cfbd-befa-4d50-9e98-9a11f1aab137 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:07.246008 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-3368cfbd-befa-4d50-9e98-9a11f1aab137 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] [instance: 5537ff84-8f70-4ba6-b219-09ffa1164d9a] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:07.253679 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3368cfbd-befa-4d50-9e98-9a11f1aab137 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:07.254244 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3368cfbd-befa-4d50-9e98-9a11f1aab137 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:07.254751 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3368cfbd-befa-4d50-9e98-9a11f1aab137 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:07.255625 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3368cfbd-befa-4d50-9e98-9a11f1aab137 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:07.256373 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3368cfbd-befa-4d50-9e98-9a11f1aab137 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:07.256876 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3368cfbd-befa-4d50-9e98-9a11f1aab137 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:07.391446 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-3368cfbd-befa-4d50-9e98-9a11f1aab137 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07fb9a216ac4683852fc6cae7c10b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8ee0bdd09b45599a7c19798660aac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:07.399428 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-3368cfbd-befa-4d50-9e98-9a11f1aab137 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] 10.222.0.65 "GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a" status: 200 len: 1551 microversion: 2.1 time: 0.158065 Aug 31 19:21:07.399991 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 438/881] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:07 2022] GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a => generated 1551 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:08.422747 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-4ff83e5e-5ce2-41ec-aa18-7d0bc6fd1bc8 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:08.423452 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-4ff83e5e-5ce2-41ec-aa18-7d0bc6fd1bc8 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] [instance: 5537ff84-8f70-4ba6-b219-09ffa1164d9a] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:08.439433 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4ff83e5e-5ce2-41ec-aa18-7d0bc6fd1bc8 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:08.445552 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4ff83e5e-5ce2-41ec-aa18-7d0bc6fd1bc8 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:08.447120 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4ff83e5e-5ce2-41ec-aa18-7d0bc6fd1bc8 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:08.448212 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4ff83e5e-5ce2-41ec-aa18-7d0bc6fd1bc8 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:08.448672 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4ff83e5e-5ce2-41ec-aa18-7d0bc6fd1bc8 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:08.449091 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4ff83e5e-5ce2-41ec-aa18-7d0bc6fd1bc8 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:08.708152 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-4ff83e5e-5ce2-41ec-aa18-7d0bc6fd1bc8 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07fb9a216ac4683852fc6cae7c10b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8ee0bdd09b45599a7c19798660aac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:08.715850 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-4ff83e5e-5ce2-41ec-aa18-7d0bc6fd1bc8 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] 10.222.0.65 "GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a" status: 200 len: 1551 microversion: 2.1 time: 0.298321 Aug 31 19:21:08.756014 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 444/882] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:08 2022] GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a => generated 1551 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:09.609352 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-576ed4db-0dac-4198-b966-8cba8229db10 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Action: 'create', calling method: .version_select at 0x7fdb861eaf70>, body: {"keypair": {"name": "tempest-keypair-440729922", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3Ea2TSMpAANCdQSExMh2n/jO8a6bWt5CZ23bAeY1r3q00frS1c2eji8nvSMPgfg9oB8AplhITixueXvUNX4yhN5x8pxInuPOld0q4JSV8RpfR04qATlbqdsWH6/uYubQ=="}} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:21:09.630104 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.quota [None req-576ed4db-0dac-4198-b966-8cba8229db10 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Getting quotas for project 12835bbc76594286925e297e824e0d91. Resources: {'key_pairs'} {{(pid=120623) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:21:09.634264 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.quota [None req-576ed4db-0dac-4198-b966-8cba8229db10 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Getting quotas for user 347993dd122543a684681c1a0783962c and project 12835bbc76594286925e297e824e0d91. Resources: {'key_pairs'} {{(pid=120623) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:21:09.661734 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-576ed4db-0dac-4198-b966-8cba8229db10 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.224566 Aug 31 19:21:09.662382 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 439/883] 10.222.0.65 () {62 vars in 1200 bytes} [Wed Aug 31 19:21:09 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 226 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 31 19:21:09.744272 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-ec16544f-2d24-41d0-bf57-f2622786f9e5 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:09.745771 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-ec16544f-2d24-41d0-bf57-f2622786f9e5 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] [instance: 5537ff84-8f70-4ba6-b219-09ffa1164d9a] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:09.775253 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ec16544f-2d24-41d0-bf57-f2622786f9e5 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:09.776116 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ec16544f-2d24-41d0-bf57-f2622786f9e5 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:09.776774 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ec16544f-2d24-41d0-bf57-f2622786f9e5 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:09.777770 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ec16544f-2d24-41d0-bf57-f2622786f9e5 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:09.780021 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ec16544f-2d24-41d0-bf57-f2622786f9e5 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:09.781376 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ec16544f-2d24-41d0-bf57-f2622786f9e5 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:09.875964 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-58562fb4-7e5e-465c-a479-1f45cd6fcdfa req-6630e6b9-5f24-48a8-97e9-e101d25c0911 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5537ff84-8f70-4ba6-b219-09ffa1164d9a", "name": "network-vif-deleted", "tag": "ac12d0b7-5798-4d48-8cb0-9040f44c18b1"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:21:09.885790 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-58562fb4-7e5e-465c-a479-1f45cd6fcdfa req-6630e6b9-5f24-48a8-97e9-e101d25c0911 service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:09.886295 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-58562fb4-7e5e-465c-a479-1f45cd6fcdfa req-6630e6b9-5f24-48a8-97e9-e101d25c0911 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:09.886927 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-58562fb4-7e5e-465c-a479-1f45cd6fcdfa req-6630e6b9-5f24-48a8-97e9-e101d25c0911 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:09.901106 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-58562fb4-7e5e-465c-a479-1f45cd6fcdfa req-6630e6b9-5f24-48a8-97e9-e101d25c0911 service nova] Creating event network-vif-deleted:ac12d0b7-5798-4d48-8cb0-9040f44c18b1 for instance 5537ff84-8f70-4ba6-b219-09ffa1164d9a on hv-cinder-83538 Aug 31 19:21:09.910190 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-58562fb4-7e5e-465c-a479-1f45cd6fcdfa req-6630e6b9-5f24-48a8-97e9-e101d25c0911 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039275 Aug 31 19:21:09.911945 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 440/884] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:21:09.921394 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-ec16544f-2d24-41d0-bf57-f2622786f9e5 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07fb9a216ac4683852fc6cae7c10b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8ee0bdd09b45599a7c19798660aac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:09.929733 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-ec16544f-2d24-41d0-bf57-f2622786f9e5 tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] 10.222.0.65 "GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a" status: 200 len: 1509 microversion: 2.1 time: 0.194626 Aug 31 19:21:09.930310 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 445/885] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:09 2022] GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a => generated 1509 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:10.951675 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-37f1af1c-9653-45d9-b1a2-a239def4d2fc tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:10.952384 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-37f1af1c-9653-45d9-b1a2-a239def4d2fc tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] [instance: 5537ff84-8f70-4ba6-b219-09ffa1164d9a] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:10.960431 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-37f1af1c-9653-45d9-b1a2-a239def4d2fc tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:10.960925 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-37f1af1c-9653-45d9-b1a2-a239def4d2fc tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:10.961399 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-37f1af1c-9653-45d9-b1a2-a239def4d2fc tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:10.962270 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-37f1af1c-9653-45d9-b1a2-a239def4d2fc tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:10.962957 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-37f1af1c-9653-45d9-b1a2-a239def4d2fc tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:10.963610 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-37f1af1c-9653-45d9-b1a2-a239def4d2fc tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:10.968564 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:10.980377 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.wsgi [None req-37f1af1c-9653-45d9-b1a2-a239def4d2fc tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] HTTP exception thrown: Instance 5537ff84-8f70-4ba6-b219-09ffa1164d9a could not be found. Aug 31 19:21:10.982400 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-37f1af1c-9653-45d9-b1a2-a239def4d2fc tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Request method failure captured: Aug 31 19:21:10.982400 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: request: GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a HTTP/1.1 Aug 31 19:21:10.982400 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Accept: application/json Aug 31 19:21:10.982400 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Accept-Encoding: identity Aug 31 19:21:10.982400 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Connection: close Aug 31 19:21:10.982400 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Content-Length: 0 Aug 31 19:21:10.982400 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Content-Type: application/json Aug 31 19:21:10.982400 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Host: 10.222.0.65 Aug 31 19:21:10.982400 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Openstack-System-Scope: None Aug 31 19:21:10.982400 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: User-Agent: python-urllib3/1.26.12 Aug 31 19:21:10.982400 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Auth-Token: gAAAAABjD7OGsfPeT-WgFEGLEucf_LE5sPeG-Ih2yAWIsJDHF6yidXjRTIjfOFLG7mntE0n0sO1kKGvhtMHRqjUsH5pVfI__zzeljRP8zyC1UKBOALdp18cnTK8WtwhqP29fUZAQ5lrG97cZRHQ0Tr0UvztHzCoFTEQR-qa-LUBK1k_ymuvtylk Aug 31 19:21:10.982400 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Domain-Id: None Aug 31 19:21:10.982400 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Domain-Name: None Aug 31 19:21:10.982400 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Identity-Status: Confirmed Aug 31 19:21:10.982400 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Is-Admin-Project: True Aug 31 19:21:10.982400 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Id: default Aug 31 19:21:10.982400 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Name: Default Aug 31 19:21:10.982400 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Id: fe8ee0bdd09b45599a7c19798660aac0 Aug 31 19:21:10.982400 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Name: tempest-TestMinimumBasicScenario-413304632 Aug 31 19:21:10.982400 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Role: member,reader Aug 31 19:21:10.982400 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Roles: member,reader Aug 31 19:21:10.983821 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/fe8ee0bdd09b45599a7c19798660aac0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/fe8ee0bdd09b45599a7c19798660aac0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_fe8ee0bdd09b45599a7c19798660aac0", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/fe8ee0bdd09b45599a7c19798660aac0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:21:10.983821 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant: tempest-TestMinimumBasicScenario-413304632 Aug 31 19:21:10.983821 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant-Id: fe8ee0bdd09b45599a7c19798660aac0 Aug 31 19:21:10.983821 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant-Name: tempest-TestMinimumBasicScenario-413304632 Aug 31 19:21:10.983821 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User: tempest-TestMinimumBasicScenario-413304632-project Aug 31 19:21:10.983821 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Id: default Aug 31 19:21:10.983821 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Name: Default Aug 31 19:21:10.983821 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Id: a07fb9a216ac4683852fc6cae7c10b99 Aug 31 19:21:10.983821 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Name: tempest-TestMinimumBasicScenario-413304632-project Aug 31 19:21:10.983821 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: method: > Aug 31 19:21:10.983821 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: exception: Instance 5537ff84-8f70-4ba6-b219-09ffa1164d9a could not be found. Aug 31 19:21:10.983821 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: action_args: {'id': '5537ff84-8f70-4ba6-b219-09ffa1164d9a'} Aug 31 19:21:10.984591 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:21:10.984591 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:21:10.984591 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:21:10.984591 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:21:10.984591 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:21:10.984591 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:21:10.984591 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:21:10.984591 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:21:10.984591 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:21:10.984591 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:21:10.984591 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5537ff84-8f70-4ba6-b219-09ffa1164d9a could not be found. Aug 31 19:21:10.984591 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:21:10.984591 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:21:10.984591 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:21:10.984591 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:21:10.984591 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:21:10.984591 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:21:10.984591 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:21:10.984591 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:21:10.984591 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:21:10.985958 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:21:10.985958 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:21:10.985958 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:21:10.985958 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:21:10.985958 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:21:10.985958 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:21:10.985958 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:21:10.985958 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5537ff84-8f70-4ba6-b219-09ffa1164d9a could not be found. Aug 31 19:21:10.985958 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:21:10.985958 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:21:10.985958 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:21:10.985958 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:21:10.985958 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:21:10.985958 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:21:10.985958 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:21:10.985958 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:21:10.985958 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5537ff84-8f70-4ba6-b219-09ffa1164d9a could not be found. Aug 31 19:21:10.985958 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:21:10.988081 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-37f1af1c-9653-45d9-b1a2-a239def4d2fc tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Returning 404 to user: Instance 5537ff84-8f70-4ba6-b219-09ffa1164d9a could not be found. {{(pid=120623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:21:10.989135 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-37f1af1c-9653-45d9-b1a2-a239def4d2fc tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] 10.222.0.65 "GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a" status: 404 len: 111 microversion: 2.1 time: 0.041813 Aug 31 19:21:10.989788 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 441/886] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:10 2022] GET /compute/v2.1/servers/5537ff84-8f70-4ba6-b219-09ffa1164d9a => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:21:10.998663 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-896dc39d-b132-4e6a-b5e8-a531bfbdacfb tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] Calling method '.version_select at 0x7fdb89c83c10>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:11.022541 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-896dc39d-b132-4e6a-b5e8-a531bfbdacfb tempest-TestMinimumBasicScenario-413304632 tempest-TestMinimumBasicScenario-413304632-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1966994" status: 202 len: 0 microversion: 2.1 time: 0.028272 Aug 31 19:21:11.023583 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 446/887] 10.222.0.65 () {58 vars in 1263 bytes} [Wed Aug 31 19:21:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1966994 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:21:11.236809 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d8b5b093-73f0-4c19-8904-a48d807e880d tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-44751021", "imageRef": "f4f2ae76-bacc-4449-881b-f697e1eeec66", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e915fb38-87df-41d0-8876-236bab429f04"}], "security_groups": [{"name": "tempest-securitygroup--515239217"}], "key_name": "tempest-keypair-440729922", "user_data": "}} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:21:11.353511 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.network.neutron [None req-d8b5b093-73f0-4c19-8904-a48d807e880d tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] validate_networks() for [('e915fb38-87df-41d0-8876-236bab429f04', None, None, None, None, None)] {{(pid=120623) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:21:11.751060 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-d8b5b093-73f0-4c19-8904-a48d807e880d tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Flavor limits 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:21:11.751521 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-d8b5b093-73f0-4c19-8904-a48d807e880d tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Image limits 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:21:11.751996 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-d8b5b093-73f0-4c19-8904-a48d807e880d tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Flavor pref 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:21:11.752410 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-d8b5b093-73f0-4c19-8904-a48d807e880d tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Image pref 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:21:11.752822 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-d8b5b093-73f0-4c19-8904-a48d807e880d tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:21:11.762552 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d8b5b093-73f0-4c19-8904-a48d807e880d tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:11.763208 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d8b5b093-73f0-4c19-8904-a48d807e880d tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:11.763649 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d8b5b093-73f0-4c19-8904-a48d807e880d tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:11.764377 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d8b5b093-73f0-4c19-8904-a48d807e880d tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:11.764833 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d8b5b093-73f0-4c19-8904-a48d807e880d tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:11.765281 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d8b5b093-73f0-4c19-8904-a48d807e880d tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:11.783909 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.quota [None req-d8b5b093-73f0-4c19-8904-a48d807e880d tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Getting quotas for project 12835bbc76594286925e297e824e0d91. Resources: {'instances', 'cores', 'ram'} {{(pid=120623) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:21:11.787946 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.quota [None req-d8b5b093-73f0-4c19-8904-a48d807e880d tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Getting quotas for user 347993dd122543a684681c1a0783962c and project 12835bbc76594286925e297e824e0d91. Resources: {'instances', 'cores', 'ram'} {{(pid=120623) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:21:11.799332 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d8b5b093-73f0-4c19-8904-a48d807e880d tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Going to run 1 instances... {{(pid=120623) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:21:11.801662 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d8b5b093-73f0-4c19-8904-a48d807e880d tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f4f2ae76-bacc-4449-881b-f697e1eeec66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120623) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:21:11.853590 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-d8b5b093-73f0-4c19-8904-a48d807e880d tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.621052 Aug 31 19:21:11.854550 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 442/888] 10.222.0.65 () {62 vars in 1188 bytes} [Wed Aug 31 19:21:11 2022] POST /compute/v2.1/servers => generated 401 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 31 19:21:11.865870 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-7ea85eda-e0c4-4202-af61-cb67cd7360fb tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:11.866824 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-7ea85eda-e0c4-4202-af61-cb67cd7360fb tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:11.931571 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-7ea85eda-e0c4-4202-af61-cb67cd7360fb tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:11.940984 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-7ea85eda-e0c4-4202-af61-cb67cd7360fb tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:11.942496 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-7ea85eda-e0c4-4202-af61-cb67cd7360fb tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:11.943602 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-7ea85eda-e0c4-4202-af61-cb67cd7360fb tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1279 microversion: 2.20 time: 0.081873 Aug 31 19:21:11.944140 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 447/889] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:21:11 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1279 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:21:12.967113 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-a3bccd6a-e581-459e-b939-5cbf746adbd5 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:12.967697 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-a3bccd6a-e581-459e-b939-5cbf746adbd5 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:12.978910 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a3bccd6a-e581-459e-b939-5cbf746adbd5 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:12.980415 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a3bccd6a-e581-459e-b939-5cbf746adbd5 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:12.985709 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a3bccd6a-e581-459e-b939-5cbf746adbd5 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:12.986733 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a3bccd6a-e581-459e-b939-5cbf746adbd5 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:12.987930 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a3bccd6a-e581-459e-b939-5cbf746adbd5 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:12.988635 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a3bccd6a-e581-459e-b939-5cbf746adbd5 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:13.089357 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-a3bccd6a-e581-459e-b939-5cbf746adbd5 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:13.104296 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-a3bccd6a-e581-459e-b939-5cbf746adbd5 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:13.105776 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-a3bccd6a-e581-459e-b939-5cbf746adbd5 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:13.106958 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-a3bccd6a-e581-459e-b939-5cbf746adbd5 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1331 microversion: 2.20 time: 0.144087 Aug 31 19:21:13.112647 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 443/890] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:21:12 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1331 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:21:14.135020 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-18ccf5ef-f712-4112-afbb-3bd0de474414 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:14.135528 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-18ccf5ef-f712-4112-afbb-3bd0de474414 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:14.138758 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:14.147265 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-18ccf5ef-f712-4112-afbb-3bd0de474414 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:14.148302 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-18ccf5ef-f712-4112-afbb-3bd0de474414 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:14.148898 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-18ccf5ef-f712-4112-afbb-3bd0de474414 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:14.150359 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-18ccf5ef-f712-4112-afbb-3bd0de474414 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:14.150815 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-18ccf5ef-f712-4112-afbb-3bd0de474414 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:14.151236 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-18ccf5ef-f712-4112-afbb-3bd0de474414 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:14.254621 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-18ccf5ef-f712-4112-afbb-3bd0de474414 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:14.268024 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-18ccf5ef-f712-4112-afbb-3bd0de474414 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:14.269935 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-18ccf5ef-f712-4112-afbb-3bd0de474414 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:14.271074 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-18ccf5ef-f712-4112-afbb-3bd0de474414 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1337 microversion: 2.20 time: 0.140467 Aug 31 19:21:14.271638 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 448/891] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:21:14 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1337 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:21:15.093159 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-22a87769-4ac8-4941-90f9-163d5d969de8 req-e765e8b3-cced-47b7-af0a-afa53409a8f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ff90966-a8dd-41ae-848d-e155bf217b05", "tag": "54483789-2137-488f-8b8d-250e234b5c3c"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:21:15.121708 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:15.126611 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-22a87769-4ac8-4941-90f9-163d5d969de8 req-e765e8b3-cced-47b7-af0a-afa53409a8f4 service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:15.127088 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-22a87769-4ac8-4941-90f9-163d5d969de8 req-e765e8b3-cced-47b7-af0a-afa53409a8f4 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:15.127498 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-22a87769-4ac8-4941-90f9-163d5d969de8 req-e765e8b3-cced-47b7-af0a-afa53409a8f4 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:15.182253 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-22a87769-4ac8-4941-90f9-163d5d969de8 req-e765e8b3-cced-47b7-af0a-afa53409a8f4 service nova] Creating event network-changed:54483789-2137-488f-8b8d-250e234b5c3c for instance 5ff90966-a8dd-41ae-848d-e155bf217b05 on hv-cinder-83538 Aug 31 19:21:15.192361 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-22a87769-4ac8-4941-90f9-163d5d969de8 req-e765e8b3-cced-47b7-af0a-afa53409a8f4 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103577 Aug 31 19:21:15.193945 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 444/892] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:21:15.300406 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-be8fb6e2-68ee-4d69-bb21-1ebb8ef00de0 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:15.301054 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-be8fb6e2-68ee-4d69-bb21-1ebb8ef00de0 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:15.315115 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-be8fb6e2-68ee-4d69-bb21-1ebb8ef00de0 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:15.315696 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-be8fb6e2-68ee-4d69-bb21-1ebb8ef00de0 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:15.320102 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-be8fb6e2-68ee-4d69-bb21-1ebb8ef00de0 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:15.321350 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-be8fb6e2-68ee-4d69-bb21-1ebb8ef00de0 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:15.323424 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-be8fb6e2-68ee-4d69-bb21-1ebb8ef00de0 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:15.323869 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-be8fb6e2-68ee-4d69-bb21-1ebb8ef00de0 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:15.626874 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-be8fb6e2-68ee-4d69-bb21-1ebb8ef00de0 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:15.643375 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-be8fb6e2-68ee-4d69-bb21-1ebb8ef00de0 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:15.648632 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-be8fb6e2-68ee-4d69-bb21-1ebb8ef00de0 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:15.653930 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-be8fb6e2-68ee-4d69-bb21-1ebb8ef00de0 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1404 microversion: 2.20 time: 0.355967 Aug 31 19:21:15.666449 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 449/893] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:21:15 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1404 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:21:16.681087 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-1ae3303c-eabc-44a6-92fd-5dfb1cc3dce9 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:16.681812 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-1ae3303c-eabc-44a6-92fd-5dfb1cc3dce9 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:16.689375 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1ae3303c-eabc-44a6-92fd-5dfb1cc3dce9 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:16.689870 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1ae3303c-eabc-44a6-92fd-5dfb1cc3dce9 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:16.690302 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1ae3303c-eabc-44a6-92fd-5dfb1cc3dce9 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:16.691006 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1ae3303c-eabc-44a6-92fd-5dfb1cc3dce9 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:16.691464 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1ae3303c-eabc-44a6-92fd-5dfb1cc3dce9 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:16.691886 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1ae3303c-eabc-44a6-92fd-5dfb1cc3dce9 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:16.931121 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1ae3303c-eabc-44a6-92fd-5dfb1cc3dce9 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:16.940753 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1ae3303c-eabc-44a6-92fd-5dfb1cc3dce9 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:16.942226 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1ae3303c-eabc-44a6-92fd-5dfb1cc3dce9 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:16.943429 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-1ae3303c-eabc-44a6-92fd-5dfb1cc3dce9 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1404 microversion: 2.20 time: 0.267133 Aug 31 19:21:16.943986 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 445/894] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:21:16 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1404 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:21:17.965847 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-77a52fc3-b9f7-4719-901b-ef49b264823f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:17.966485 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-77a52fc3-b9f7-4719-901b-ef49b264823f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:17.973249 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-77a52fc3-b9f7-4719-901b-ef49b264823f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:17.973743 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-77a52fc3-b9f7-4719-901b-ef49b264823f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:17.974179 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-77a52fc3-b9f7-4719-901b-ef49b264823f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:17.974882 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-77a52fc3-b9f7-4719-901b-ef49b264823f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:17.975331 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-77a52fc3-b9f7-4719-901b-ef49b264823f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:17.975749 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-77a52fc3-b9f7-4719-901b-ef49b264823f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:18.122852 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-77a52fc3-b9f7-4719-901b-ef49b264823f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:18.131968 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-77a52fc3-b9f7-4719-901b-ef49b264823f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:18.133429 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-77a52fc3-b9f7-4719-901b-ef49b264823f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:18.134524 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-77a52fc3-b9f7-4719-901b-ef49b264823f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1404 microversion: 2.20 time: 0.173003 Aug 31 19:21:18.135073 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 450/895] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:21:17 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1404 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:21:19.156605 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-fc201b63-310f-43e5-ac00-1038a533721e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:19.157263 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-fc201b63-310f-43e5-ac00-1038a533721e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:19.163850 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fc201b63-310f-43e5-ac00-1038a533721e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:19.164334 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fc201b63-310f-43e5-ac00-1038a533721e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:19.164953 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fc201b63-310f-43e5-ac00-1038a533721e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:19.165844 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fc201b63-310f-43e5-ac00-1038a533721e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:19.166452 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fc201b63-310f-43e5-ac00-1038a533721e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:19.167038 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fc201b63-310f-43e5-ac00-1038a533721e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:19.338373 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-fc201b63-310f-43e5-ac00-1038a533721e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:19.347147 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-fc201b63-310f-43e5-ac00-1038a533721e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:19.348993 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-fc201b63-310f-43e5-ac00-1038a533721e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:19.350176 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-fc201b63-310f-43e5-ac00-1038a533721e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1404 microversion: 2.20 time: 0.198070 Aug 31 19:21:19.353226 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 446/896] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:21:19 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1404 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:21:20.372861 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-0763aa79-f558-4cff-8fc9-c66259aa132b tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:20.373437 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-0763aa79-f558-4cff-8fc9-c66259aa132b tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:20.380059 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0763aa79-f558-4cff-8fc9-c66259aa132b tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:20.380545 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0763aa79-f558-4cff-8fc9-c66259aa132b tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:20.380974 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0763aa79-f558-4cff-8fc9-c66259aa132b tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:20.381694 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0763aa79-f558-4cff-8fc9-c66259aa132b tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:20.382151 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0763aa79-f558-4cff-8fc9-c66259aa132b tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:20.382564 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0763aa79-f558-4cff-8fc9-c66259aa132b tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:20.508516 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-0763aa79-f558-4cff-8fc9-c66259aa132b tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:20.516632 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-0763aa79-f558-4cff-8fc9-c66259aa132b tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:20.518102 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-0763aa79-f558-4cff-8fc9-c66259aa132b tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:20.519194 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-0763aa79-f558-4cff-8fc9-c66259aa132b tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1404 microversion: 2.20 time: 0.151093 Aug 31 19:21:20.519775 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 451/897] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:21:20 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1404 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:21:20.867723 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-c88b1a7a-8091-4948-bd52-8c691c757596 req-a5b04283-67a9-44c7-ab0d-50c50da8ab28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ff90966-a8dd-41ae-848d-e155bf217b05", "name": "network-vif-plugged", "status": "completed", "tag": "54483789-2137-488f-8b8d-250e234b5c3c"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:21:20.878480 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-c88b1a7a-8091-4948-bd52-8c691c757596 req-a5b04283-67a9-44c7-ab0d-50c50da8ab28 service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:20.878963 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-c88b1a7a-8091-4948-bd52-8c691c757596 req-a5b04283-67a9-44c7-ab0d-50c50da8ab28 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:20.879405 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-c88b1a7a-8091-4948-bd52-8c691c757596 req-a5b04283-67a9-44c7-ab0d-50c50da8ab28 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:20.891195 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-c88b1a7a-8091-4948-bd52-8c691c757596 req-a5b04283-67a9-44c7-ab0d-50c50da8ab28 service nova] Creating event network-vif-plugged:54483789-2137-488f-8b8d-250e234b5c3c for instance 5ff90966-a8dd-41ae-848d-e155bf217b05 on hv-cinder-83538 Aug 31 19:21:20.896025 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-c88b1a7a-8091-4948-bd52-8c691c757596 req-a5b04283-67a9-44c7-ab0d-50c50da8ab28 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032089 Aug 31 19:21:20.896866 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 447/898] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:21:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:21:21.542326 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-13f66415-cfa9-40a4-9aa0-bff33596caa4 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:21.542945 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-13f66415-cfa9-40a4-9aa0-bff33596caa4 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:21.549945 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-13f66415-cfa9-40a4-9aa0-bff33596caa4 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:21.550415 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-13f66415-cfa9-40a4-9aa0-bff33596caa4 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:21.550838 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-13f66415-cfa9-40a4-9aa0-bff33596caa4 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:21.551512 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-13f66415-cfa9-40a4-9aa0-bff33596caa4 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:21.551954 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-13f66415-cfa9-40a4-9aa0-bff33596caa4 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:21.552362 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-13f66415-cfa9-40a4-9aa0-bff33596caa4 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:21.681788 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-13f66415-cfa9-40a4-9aa0-bff33596caa4 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:21.690268 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-13f66415-cfa9-40a4-9aa0-bff33596caa4 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:21.691681 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-13f66415-cfa9-40a4-9aa0-bff33596caa4 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:21.692757 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-13f66415-cfa9-40a4-9aa0-bff33596caa4 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1404 microversion: 2.20 time: 0.154443 Aug 31 19:21:21.693335 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 452/899] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:21:21 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1404 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:21:22.715546 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-6b027c6e-5035-4fb9-a7ee-5eabeab90b05 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:22.716164 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-6b027c6e-5035-4fb9-a7ee-5eabeab90b05 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:22.718157 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell0:SELECT=2 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:22.718828 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell0:SELECT=10 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:22.725366 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6b027c6e-5035-4fb9-a7ee-5eabeab90b05 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:22.725834 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6b027c6e-5035-4fb9-a7ee-5eabeab90b05 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:22.726265 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6b027c6e-5035-4fb9-a7ee-5eabeab90b05 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:22.726948 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6b027c6e-5035-4fb9-a7ee-5eabeab90b05 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:22.727398 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6b027c6e-5035-4fb9-a7ee-5eabeab90b05 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:22.727824 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6b027c6e-5035-4fb9-a7ee-5eabeab90b05 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:22.859466 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-6b027c6e-5035-4fb9-a7ee-5eabeab90b05 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:22.867678 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-6b027c6e-5035-4fb9-a7ee-5eabeab90b05 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:22.869114 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-6b027c6e-5035-4fb9-a7ee-5eabeab90b05 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:22.870298 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-6b027c6e-5035-4fb9-a7ee-5eabeab90b05 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1596 microversion: 2.20 time: 0.159374 Aug 31 19:21:22.870855 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 448/900] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:21:22 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1596 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:21:22.893355 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-3da373aa-4a9e-4c18-9034-25464adc20a8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:22.893897 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-3da373aa-4a9e-4c18-9034-25464adc20a8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:22.895622 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell0:SELECT=2 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:22.901161 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3da373aa-4a9e-4c18-9034-25464adc20a8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:22.901660 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3da373aa-4a9e-4c18-9034-25464adc20a8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:22.902089 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3da373aa-4a9e-4c18-9034-25464adc20a8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:22.902768 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3da373aa-4a9e-4c18-9034-25464adc20a8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:22.903708 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3da373aa-4a9e-4c18-9034-25464adc20a8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:22.904121 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3da373aa-4a9e-4c18-9034-25464adc20a8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:22.981704 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-3da373aa-4a9e-4c18-9034-25464adc20a8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.091469 Aug 31 19:21:22.982435 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 453/901] 10.222.0.65 () {60 vars in 1316 bytes} [Wed Aug 31 19:21:22 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 19:21:24.143554 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-dda3980b-f045-4020-a36d-ccfda5ef4841 req-57d9835f-3cc4-4d07-8612-0789c0ea4b71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ff90966-a8dd-41ae-848d-e155bf217b05", "tag": "54483789-2137-488f-8b8d-250e234b5c3c"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:21:24.154061 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-dda3980b-f045-4020-a36d-ccfda5ef4841 req-57d9835f-3cc4-4d07-8612-0789c0ea4b71 service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:24.154611 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-dda3980b-f045-4020-a36d-ccfda5ef4841 req-57d9835f-3cc4-4d07-8612-0789c0ea4b71 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:24.155109 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-dda3980b-f045-4020-a36d-ccfda5ef4841 req-57d9835f-3cc4-4d07-8612-0789c0ea4b71 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:24.166288 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-dda3980b-f045-4020-a36d-ccfda5ef4841 req-57d9835f-3cc4-4d07-8612-0789c0ea4b71 service nova] Creating event network-changed:54483789-2137-488f-8b8d-250e234b5c3c for instance 5ff90966-a8dd-41ae-848d-e155bf217b05 on hv-cinder-83538 Aug 31 19:21:24.171181 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-dda3980b-f045-4020-a36d-ccfda5ef4841 req-57d9835f-3cc4-4d07-8612-0789c0ea4b71 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031265 Aug 31 19:21:24.172000 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 449/902] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:21:34.171907 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_api:SELECT=11 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:34.172720 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=50,nova_cell1:INSERT=1 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:34.176672 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-bc99a7f4-9d51-4a23-b4aa-ff4f996a0ff8 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:34.177159 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-bc99a7f4-9d51-4a23-b4aa-ff4f996a0ff8 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: 0ae1a222-b48a-4e85-8c65-5d3dccd56f1e] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:34.184119 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bc99a7f4-9d51-4a23-b4aa-ff4f996a0ff8 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:34.184595 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bc99a7f4-9d51-4a23-b4aa-ff4f996a0ff8 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:34.185023 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bc99a7f4-9d51-4a23-b4aa-ff4f996a0ff8 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:34.185741 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bc99a7f4-9d51-4a23-b4aa-ff4f996a0ff8 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:34.186192 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bc99a7f4-9d51-4a23-b4aa-ff4f996a0ff8 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:34.186613 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bc99a7f4-9d51-4a23-b4aa-ff4f996a0ff8 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:34.211144 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-bc99a7f4-9d51-4a23-b4aa-ff4f996a0ff8 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/0ae1a222-b48a-4e85-8c65-5d3dccd56f1e/ips" status: 200 len: 148 microversion: 2.1 time: 0.040447 Aug 31 19:21:34.211712 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 454/903] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Aug 31 19:21:34 2022] GET /compute/v2.1/servers/0ae1a222-b48a-4e85-8c65-5d3dccd56f1e/ips => generated 148 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:21:35.530135 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=11 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:35.530891 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=32 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:35.535247 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-72a6d654-cce5-4e85-a436-f235bce7af62 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "945147f6-7070-4eb1-8e90-34ea49c3141e"}} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:21:35.537723 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-72a6d654-cce5-4e85-a436-f235bce7af62 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: 0ae1a222-b48a-4e85-8c65-5d3dccd56f1e] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:35.545032 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-72a6d654-cce5-4e85-a436-f235bce7af62 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:35.545538 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-72a6d654-cce5-4e85-a436-f235bce7af62 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:35.545975 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-72a6d654-cce5-4e85-a436-f235bce7af62 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:35.546660 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-72a6d654-cce5-4e85-a436-f235bce7af62 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:35.547115 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-72a6d654-cce5-4e85-a436-f235bce7af62 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:35.547539 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-72a6d654-cce5-4e85-a436-f235bce7af62 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:35.810355 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-72a6d654-cce5-4e85-a436-f235bce7af62 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "POST /compute/v2.1/servers/0ae1a222-b48a-4e85-8c65-5d3dccd56f1e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281422 Aug 31 19:21:35.813300 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 450/904] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 31 19:21:35 2022] POST /compute/v2.1/servers/0ae1a222-b48a-4e85-8c65-5d3dccd56f1e/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:21:43.327390 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-57cc78e0-df0f-4b90-be22-bac2aaf2353a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "945147f6-7070-4eb1-8e90-34ea49c3141e"}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:21:43.329801 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-57cc78e0-df0f-4b90-be22-bac2aaf2353a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: 0ae1a222-b48a-4e85-8c65-5d3dccd56f1e] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:43.336126 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-57cc78e0-df0f-4b90-be22-bac2aaf2353a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:43.336675 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-57cc78e0-df0f-4b90-be22-bac2aaf2353a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:43.337108 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-57cc78e0-df0f-4b90-be22-bac2aaf2353a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:43.337828 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-57cc78e0-df0f-4b90-be22-bac2aaf2353a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:43.338279 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-57cc78e0-df0f-4b90-be22-bac2aaf2353a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:43.338699 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-57cc78e0-df0f-4b90-be22-bac2aaf2353a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:43.416117 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.wsgi [None req-57cc78e0-df0f-4b90-be22-bac2aaf2353a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] HTTP exception thrown: Invalid volume: volume 945147f6-7070-4eb1-8e90-34ea49c3141e is already attached to instances: 0ae1a222-b48a-4e85-8c65-5d3dccd56f1e Aug 31 19:21:43.417850 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-57cc78e0-df0f-4b90-be22-bac2aaf2353a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Request method failure captured: Aug 31 19:21:43.417850 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: request: POST /compute/v2.1/servers/0ae1a222-b48a-4e85-8c65-5d3dccd56f1e/os-volume_attachments HTTP/1.1 Aug 31 19:21:43.417850 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept: application/json Aug 31 19:21:43.417850 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Aug 31 19:21:43.417850 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Connection: close Aug 31 19:21:43.417850 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Length: 74 Aug 31 19:21:43.417850 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Type: application/json Aug 31 19:21:43.417850 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Host: 10.222.0.65 Aug 31 19:21:43.417850 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Aug 31 19:21:43.417850 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Aug 31 19:21:43.417850 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjD7KQFx_CTgljpc_qTbwt7yeZ02hQJcRRTGjLujiMjCCm-y4KZuXdAcd8yicyJshoDc3mgcG2dVFxaRyv0OYT2U8p5W3ZDfvXP2qQyvl9GhMqVycMoUFtordGBMOd64j9xBsCCsuy7lF-JjelfCeTLgdgY5owS10WSU3cjBe8ulEuuUA Aug 31 19:21:43.417850 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Aug 31 19:21:43.417850 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Aug 31 19:21:43.417850 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Aug 31 19:21:43.417850 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Aug 31 19:21:43.417850 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Aug 31 19:21:43.417850 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Aug 31 19:21:43.417850 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Id: e6d782400f1e432c8d10a31334c42e68 Aug 31 19:21:43.417850 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-AttachVolumeNegativeTest-739769459 Aug 31 19:21:43.417850 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Role: member,reader Aug 31 19:21:43.417850 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Roles: member,reader Aug 31 19:21:43.419497 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/e6d782400f1e432c8d10a31334c42e68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e6d782400f1e432c8d10a31334c42e68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_e6d782400f1e432c8d10a31334c42e68", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e6d782400f1e432c8d10a31334c42e68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:21:43.419497 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-AttachVolumeNegativeTest-739769459 Aug 31 19:21:43.419497 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Id: e6d782400f1e432c8d10a31334c42e68 Aug 31 19:21:43.419497 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-739769459 Aug 31 19:21:43.419497 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User: tempest-AttachVolumeNegativeTest-739769459-project Aug 31 19:21:43.419497 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Aug 31 19:21:43.419497 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Aug 31 19:21:43.419497 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Id: 0bfa1533b0944bd681f4c2a33cf701b0 Aug 31 19:21:43.419497 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-AttachVolumeNegativeTest-739769459-project Aug 31 19:21:43.419497 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Aug 31 19:21:43.419497 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: {"volumeAttachment": {"volumeId": "945147f6-7070-4eb1-8e90-34ea49c3141e"}} Aug 31 19:21:43.419497 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: method: > Aug 31 19:21:43.420448 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: exception: Invalid volume: volume 945147f6-7070-4eb1-8e90-34ea49c3141e is already attached to instances: 0ae1a222-b48a-4e85-8c65-5d3dccd56f1e Aug 31 19:21:43.420448 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: action_args: {'server_id': '0ae1a222-b48a-4e85-8c65-5d3dccd56f1e', 'body': {'volumeAttachment': {'volumeId': '945147f6-7070-4eb1-8e90-34ea49c3141e'}}} Aug 31 19:21:43.420448 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:21:43.420448 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:21:43.420448 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 19:21:43.420448 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 19:21:43.420448 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 19:21:43.420448 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 19:21:43.420448 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 19:21:43.420448 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 19:21:43.420448 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 31 19:21:43.420448 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 31 19:21:43.420448 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 31 19:21:43.420448 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 31 19:21:43.420448 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 945147f6-7070-4eb1-8e90-34ea49c3141e is already attached to instances: 0ae1a222-b48a-4e85-8c65-5d3dccd56f1e Aug 31 19:21:43.420448 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:21:43.420448 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:21:43.420448 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:21:43.420448 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:21:43.421757 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:21:43.421757 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:21:43.421757 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:21:43.421757 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:21:43.421757 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:21:43.421757 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:21:43.421757 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 19:21:43.421757 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 19:21:43.421757 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 19:21:43.421757 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 19:21:43.421757 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 19:21:43.421757 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 19:21:43.421757 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 31 19:21:43.421757 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 19:21:43.421757 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 945147f6-7070-4eb1-8e90-34ea49c3141e is already attached to instances: 0ae1a222-b48a-4e85-8c65-5d3dccd56f1e Aug 31 19:21:43.421757 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:21:43.421757 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:21:43.421757 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:21:43.421757 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:21:43.421757 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:21:43.423136 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:21:43.423136 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:21:43.423136 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:21:43.423136 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 945147f6-7070-4eb1-8e90-34ea49c3141e is already attached to instances: 0ae1a222-b48a-4e85-8c65-5d3dccd56f1e Aug 31 19:21:43.423136 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:21:43.423136 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-57cc78e0-df0f-4b90-be22-bac2aaf2353a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Returning 400 to user: Invalid volume: volume 945147f6-7070-4eb1-8e90-34ea49c3141e is already attached to instances: 0ae1a222-b48a-4e85-8c65-5d3dccd56f1e {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:21:43.423136 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-57cc78e0-df0f-4b90-be22-bac2aaf2353a tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "POST /compute/v2.1/servers/0ae1a222-b48a-4e85-8c65-5d3dccd56f1e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096514 Aug 31 19:21:43.423136 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 455/905] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 31 19:21:43 2022] POST /compute/v2.1/servers/0ae1a222-b48a-4e85-8c65-5d3dccd56f1e/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 19:21:43.485168 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-4f675b19-28f8-4001-a4f3-f81f28629497 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:43.485811 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-4f675b19-28f8-4001-a4f3-f81f28629497 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: 0ae1a222-b48a-4e85-8c65-5d3dccd56f1e] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:43.491912 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4f675b19-28f8-4001-a4f3-f81f28629497 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:43.492393 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4f675b19-28f8-4001-a4f3-f81f28629497 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:43.492825 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4f675b19-28f8-4001-a4f3-f81f28629497 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:43.493542 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4f675b19-28f8-4001-a4f3-f81f28629497 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:43.493991 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4f675b19-28f8-4001-a4f3-f81f28629497 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:43.494411 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4f675b19-28f8-4001-a4f3-f81f28629497 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:43.572638 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.objects.instance [None req-4f675b19-28f8-4001-a4f3-f81f28629497 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lazy-loading 'services' on Instance uuid 0ae1a222-b48a-4e85-8c65-5d3dccd56f1e {{(pid=120623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:21:43.642021 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-4f675b19-28f8-4001-a4f3-f81f28629497 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "DELETE /compute/v2.1/servers/0ae1a222-b48a-4e85-8c65-5d3dccd56f1e/os-volume_attachments/945147f6-7070-4eb1-8e90-34ea49c3141e" status: 202 len: 0 microversion: 2.1 time: 0.162019 Aug 31 19:21:43.642588 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 451/906] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Aug 31 19:21:43 2022] DELETE /compute/v2.1/servers/0ae1a222-b48a-4e85-8c65-5d3dccd56f1e/os-volume_attachments/945147f6-7070-4eb1-8e90-34ea49c3141e => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:21:43.650941 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-b67c802e-96b7-42e1-9073-196ef2f133c5 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:43.653894 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-b67c802e-96b7-42e1-9073-196ef2f133c5 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: 0ae1a222-b48a-4e85-8c65-5d3dccd56f1e] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:43.660713 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b67c802e-96b7-42e1-9073-196ef2f133c5 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:43.661254 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b67c802e-96b7-42e1-9073-196ef2f133c5 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:43.661955 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b67c802e-96b7-42e1-9073-196ef2f133c5 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:43.662706 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b67c802e-96b7-42e1-9073-196ef2f133c5 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:43.663402 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b67c802e-96b7-42e1-9073-196ef2f133c5 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:43.663818 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b67c802e-96b7-42e1-9073-196ef2f133c5 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:43.695056 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-b67c802e-96b7-42e1-9073-196ef2f133c5 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/0ae1a222-b48a-4e85-8c65-5d3dccd56f1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048095 Aug 31 19:21:43.695619 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 456/907] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 31 19:21:43 2022] GET /compute/v2.1/servers/0ae1a222-b48a-4e85-8c65-5d3dccd56f1e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:21:44.708718 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-87e124c7-f06a-4bfe-8bfb-e4f876cdef16 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:44.711088 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-87e124c7-f06a-4bfe-8bfb-e4f876cdef16 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: 0ae1a222-b48a-4e85-8c65-5d3dccd56f1e] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:44.718198 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-87e124c7-f06a-4bfe-8bfb-e4f876cdef16 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:44.718679 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-87e124c7-f06a-4bfe-8bfb-e4f876cdef16 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:44.719111 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-87e124c7-f06a-4bfe-8bfb-e4f876cdef16 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:44.719802 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-87e124c7-f06a-4bfe-8bfb-e4f876cdef16 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:44.720250 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-87e124c7-f06a-4bfe-8bfb-e4f876cdef16 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:44.720689 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-87e124c7-f06a-4bfe-8bfb-e4f876cdef16 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:44.750091 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-87e124c7-f06a-4bfe-8bfb-e4f876cdef16 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/0ae1a222-b48a-4e85-8c65-5d3dccd56f1e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046263 Aug 31 19:21:44.750636 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 452/908] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 31 19:21:44 2022] GET /compute/v2.1/servers/0ae1a222-b48a-4e85-8c65-5d3dccd56f1e/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 19:21:44.811466 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-40ee09fe-b4c7-426a-89a7-e0e51923be51 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:44.811948 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-40ee09fe-b4c7-426a-89a7-e0e51923be51 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: 0ae1a222-b48a-4e85-8c65-5d3dccd56f1e] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:44.818260 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-40ee09fe-b4c7-426a-89a7-e0e51923be51 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:44.818729 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-40ee09fe-b4c7-426a-89a7-e0e51923be51 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:44.819153 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-40ee09fe-b4c7-426a-89a7-e0e51923be51 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:44.819820 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-40ee09fe-b4c7-426a-89a7-e0e51923be51 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:44.820257 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-40ee09fe-b4c7-426a-89a7-e0e51923be51 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:44.820667 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-40ee09fe-b4c7-426a-89a7-e0e51923be51 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:44.845302 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-40ee09fe-b4c7-426a-89a7-e0e51923be51 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: 0ae1a222-b48a-4e85-8c65-5d3dccd56f1e] Going to try to terminate instance {{(pid=120624) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 19:21:44.918820 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-40ee09fe-b4c7-426a-89a7-e0e51923be51 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "DELETE /compute/v2.1/servers/0ae1a222-b48a-4e85-8c65-5d3dccd56f1e" status: 204 len: 0 microversion: 2.1 time: 0.110260 Aug 31 19:21:44.919454 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 457/909] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 31 19:21:44 2022] DELETE /compute/v2.1/servers/0ae1a222-b48a-4e85-8c65-5d3dccd56f1e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:21:44.927610 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d79eee4b-b1d5-441e-af23-53785a69f3cf tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:44.928218 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d79eee4b-b1d5-441e-af23-53785a69f3cf tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: 0ae1a222-b48a-4e85-8c65-5d3dccd56f1e] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:44.934123 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d79eee4b-b1d5-441e-af23-53785a69f3cf tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:44.934606 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d79eee4b-b1d5-441e-af23-53785a69f3cf tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:44.935036 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d79eee4b-b1d5-441e-af23-53785a69f3cf tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:44.935716 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d79eee4b-b1d5-441e-af23-53785a69f3cf tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:44.936166 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d79eee4b-b1d5-441e-af23-53785a69f3cf tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:44.936585 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d79eee4b-b1d5-441e-af23-53785a69f3cf tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:45.068338 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-d79eee4b-b1d5-441e-af23-53785a69f3cf tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:45.076064 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-d79eee4b-b1d5-441e-af23-53785a69f3cf tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/0ae1a222-b48a-4e85-8c65-5d3dccd56f1e" status: 200 len: 1678 microversion: 2.1 time: 0.152255 Aug 31 19:21:45.076626 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 453/910] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:44 2022] GET /compute/v2.1/servers/0ae1a222-b48a-4e85-8c65-5d3dccd56f1e => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:46.099181 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-339ea4af-ab21-4009-b881-e1792c9abac0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:46.099944 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-339ea4af-ab21-4009-b881-e1792c9abac0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: 0ae1a222-b48a-4e85-8c65-5d3dccd56f1e] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:46.106673 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-339ea4af-ab21-4009-b881-e1792c9abac0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:46.107150 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-339ea4af-ab21-4009-b881-e1792c9abac0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:46.107581 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-339ea4af-ab21-4009-b881-e1792c9abac0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:46.108268 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-339ea4af-ab21-4009-b881-e1792c9abac0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:46.108735 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-339ea4af-ab21-4009-b881-e1792c9abac0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:46.109138 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-339ea4af-ab21-4009-b881-e1792c9abac0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:46.240597 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-339ea4af-ab21-4009-b881-e1792c9abac0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:46.248838 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-339ea4af-ab21-4009-b881-e1792c9abac0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/0ae1a222-b48a-4e85-8c65-5d3dccd56f1e" status: 200 len: 1678 microversion: 2.1 time: 0.154587 Aug 31 19:21:46.249426 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 458/911] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:46 2022] GET /compute/v2.1/servers/0ae1a222-b48a-4e85-8c65-5d3dccd56f1e => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:47.270497 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-5b569e5f-1ba6-466b-b0ab-e2978724323b tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:47.271105 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-5b569e5f-1ba6-466b-b0ab-e2978724323b tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: 0ae1a222-b48a-4e85-8c65-5d3dccd56f1e] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:47.277560 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5b569e5f-1ba6-466b-b0ab-e2978724323b tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:47.278050 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5b569e5f-1ba6-466b-b0ab-e2978724323b tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:47.278478 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5b569e5f-1ba6-466b-b0ab-e2978724323b tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:47.279164 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5b569e5f-1ba6-466b-b0ab-e2978724323b tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:47.279615 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5b569e5f-1ba6-466b-b0ab-e2978724323b tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:47.280035 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5b569e5f-1ba6-466b-b0ab-e2978724323b tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:47.499325 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-5b569e5f-1ba6-466b-b0ab-e2978724323b tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:47.510196 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-5b569e5f-1ba6-466b-b0ab-e2978724323b tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/0ae1a222-b48a-4e85-8c65-5d3dccd56f1e" status: 200 len: 1678 microversion: 2.1 time: 0.243600 Aug 31 19:21:47.510763 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 454/912] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:47 2022] GET /compute/v2.1/servers/0ae1a222-b48a-4e85-8c65-5d3dccd56f1e => generated 1678 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:48.037355 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-82bcfd65-72de-458e-801a-a69ff895732c req-02f2b418-ce6a-43df-8184-9f9928dbc013 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ae1a222-b48a-4e85-8c65-5d3dccd56f1e", "name": "network-vif-deleted", "tag": "f8252d75-812c-42e5-ae8c-3758c5342769"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:21:48.049920 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-82bcfd65-72de-458e-801a-a69ff895732c req-02f2b418-ce6a-43df-8184-9f9928dbc013 service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:48.050402 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-82bcfd65-72de-458e-801a-a69ff895732c req-02f2b418-ce6a-43df-8184-9f9928dbc013 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:48.050833 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-82bcfd65-72de-458e-801a-a69ff895732c req-02f2b418-ce6a-43df-8184-9f9928dbc013 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:48.064318 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-82bcfd65-72de-458e-801a-a69ff895732c req-02f2b418-ce6a-43df-8184-9f9928dbc013 service nova] Creating event network-vif-deleted:f8252d75-812c-42e5-ae8c-3758c5342769 for instance 0ae1a222-b48a-4e85-8c65-5d3dccd56f1e on hv-cinder-83538 Aug 31 19:21:48.069581 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-82bcfd65-72de-458e-801a-a69ff895732c req-02f2b418-ce6a-43df-8184-9f9928dbc013 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036204 Aug 31 19:21:48.070787 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 459/913] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:21:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:21:48.541646 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-25f919dd-5aaf-472b-b5e3-bfd36f6dbfaa tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:48.542294 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-25f919dd-5aaf-472b-b5e3-bfd36f6dbfaa tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: 0ae1a222-b48a-4e85-8c65-5d3dccd56f1e] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:48.549826 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-25f919dd-5aaf-472b-b5e3-bfd36f6dbfaa tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:48.550314 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-25f919dd-5aaf-472b-b5e3-bfd36f6dbfaa tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:48.550749 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-25f919dd-5aaf-472b-b5e3-bfd36f6dbfaa tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:48.551453 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-25f919dd-5aaf-472b-b5e3-bfd36f6dbfaa tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:48.551902 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-25f919dd-5aaf-472b-b5e3-bfd36f6dbfaa tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:48.552322 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-25f919dd-5aaf-472b-b5e3-bfd36f6dbfaa tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:48.587908 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-25f919dd-5aaf-472b-b5e3-bfd36f6dbfaa tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:48.588400 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-25f919dd-5aaf-472b-b5e3-bfd36f6dbfaa tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:48.588835 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-25f919dd-5aaf-472b-b5e3-bfd36f6dbfaa tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:48.589316 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.objects.instance [None req-25f919dd-5aaf-472b-b5e3-bfd36f6dbfaa tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lazy-loading 'fault' on Instance uuid 0ae1a222-b48a-4e85-8c65-5d3dccd56f1e {{(pid=120623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:21:48.633442 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-25f919dd-5aaf-472b-b5e3-bfd36f6dbfaa tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:48.641917 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-25f919dd-5aaf-472b-b5e3-bfd36f6dbfaa tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/0ae1a222-b48a-4e85-8c65-5d3dccd56f1e" status: 200 len: 1330 microversion: 2.1 time: 0.104213 Aug 31 19:21:48.642504 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 455/914] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:48 2022] GET /compute/v2.1/servers/0ae1a222-b48a-4e85-8c65-5d3dccd56f1e => generated 1330 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:49.665573 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-7178c371-3089-44a8-a2eb-53b379dedab6 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:49.666261 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-7178c371-3089-44a8-a2eb-53b379dedab6 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: 0ae1a222-b48a-4e85-8c65-5d3dccd56f1e] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:49.672849 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7178c371-3089-44a8-a2eb-53b379dedab6 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:49.673356 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7178c371-3089-44a8-a2eb-53b379dedab6 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:49.673782 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7178c371-3089-44a8-a2eb-53b379dedab6 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:49.674458 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7178c371-3089-44a8-a2eb-53b379dedab6 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:49.674900 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7178c371-3089-44a8-a2eb-53b379dedab6 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:49.675315 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7178c371-3089-44a8-a2eb-53b379dedab6 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:49.688699 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.wsgi [None req-7178c371-3089-44a8-a2eb-53b379dedab6 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] HTTP exception thrown: Instance 0ae1a222-b48a-4e85-8c65-5d3dccd56f1e could not be found. Aug 31 19:21:49.690302 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-7178c371-3089-44a8-a2eb-53b379dedab6 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Request method failure captured: Aug 31 19:21:49.690302 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: request: GET /compute/v2.1/servers/0ae1a222-b48a-4e85-8c65-5d3dccd56f1e HTTP/1.1 Aug 31 19:21:49.690302 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept: application/json Aug 31 19:21:49.690302 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Aug 31 19:21:49.690302 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Connection: close Aug 31 19:21:49.690302 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Length: 0 Aug 31 19:21:49.690302 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Type: application/json Aug 31 19:21:49.690302 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Host: 10.222.0.65 Aug 31 19:21:49.690302 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Aug 31 19:21:49.690302 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Aug 31 19:21:49.690302 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjD7KQFx_CTgljpc_qTbwt7yeZ02hQJcRRTGjLujiMjCCm-y4KZuXdAcd8yicyJshoDc3mgcG2dVFxaRyv0OYT2U8p5W3ZDfvXP2qQyvl9GhMqVycMoUFtordGBMOd64j9xBsCCsuy7lF-JjelfCeTLgdgY5owS10WSU3cjBe8ulEuuUA Aug 31 19:21:49.690302 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Aug 31 19:21:49.690302 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Aug 31 19:21:49.690302 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Aug 31 19:21:49.690302 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Aug 31 19:21:49.690302 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Aug 31 19:21:49.690302 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Aug 31 19:21:49.690302 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Id: e6d782400f1e432c8d10a31334c42e68 Aug 31 19:21:49.690302 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-AttachVolumeNegativeTest-739769459 Aug 31 19:21:49.690302 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Role: member,reader Aug 31 19:21:49.690302 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Roles: member,reader Aug 31 19:21:49.691977 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/e6d782400f1e432c8d10a31334c42e68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e6d782400f1e432c8d10a31334c42e68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_e6d782400f1e432c8d10a31334c42e68", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e6d782400f1e432c8d10a31334c42e68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:21:49.691977 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-AttachVolumeNegativeTest-739769459 Aug 31 19:21:49.691977 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Id: e6d782400f1e432c8d10a31334c42e68 Aug 31 19:21:49.691977 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-739769459 Aug 31 19:21:49.691977 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User: tempest-AttachVolumeNegativeTest-739769459-project Aug 31 19:21:49.691977 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Aug 31 19:21:49.691977 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Aug 31 19:21:49.691977 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Id: 0bfa1533b0944bd681f4c2a33cf701b0 Aug 31 19:21:49.691977 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-AttachVolumeNegativeTest-739769459-project Aug 31 19:21:49.691977 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: method: > Aug 31 19:21:49.691977 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: exception: Instance 0ae1a222-b48a-4e85-8c65-5d3dccd56f1e could not be found. Aug 31 19:21:49.691977 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: action_args: {'id': '0ae1a222-b48a-4e85-8c65-5d3dccd56f1e'} Aug 31 19:21:49.693039 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:21:49.693039 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:21:49.693039 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:21:49.693039 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:21:49.693039 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:21:49.693039 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:21:49.693039 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:21:49.693039 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:21:49.693039 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:21:49.693039 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:21:49.693039 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ae1a222-b48a-4e85-8c65-5d3dccd56f1e could not be found. Aug 31 19:21:49.693039 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:21:49.693039 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:21:49.693039 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:21:49.693039 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:21:49.693039 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:21:49.693039 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:21:49.693039 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:21:49.693039 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:21:49.693039 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:21:49.694576 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:21:49.694576 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:21:49.694576 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:21:49.694576 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:21:49.694576 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:21:49.694576 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:21:49.694576 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:21:49.694576 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ae1a222-b48a-4e85-8c65-5d3dccd56f1e could not be found. Aug 31 19:21:49.694576 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:21:49.694576 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:21:49.694576 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:21:49.694576 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:21:49.694576 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:21:49.694576 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:21:49.694576 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:21:49.694576 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:21:49.694576 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ae1a222-b48a-4e85-8c65-5d3dccd56f1e could not be found. Aug 31 19:21:49.694576 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:21:49.696067 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-7178c371-3089-44a8-a2eb-53b379dedab6 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Returning 404 to user: Instance 0ae1a222-b48a-4e85-8c65-5d3dccd56f1e could not be found. {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:21:49.696067 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-7178c371-3089-44a8-a2eb-53b379dedab6 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/0ae1a222-b48a-4e85-8c65-5d3dccd56f1e" status: 404 len: 111 microversion: 2.1 time: 0.031640 Aug 31 19:21:49.696067 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 460/915] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:49 2022] GET /compute/v2.1/servers/0ae1a222-b48a-4e85-8c65-5d3dccd56f1e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:21:49.700566 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-977a9761-1cb4-4535-a8bf-fe5a80673efb tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '.version_select at 0x7fdb861eaee0>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:49.718345 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-977a9761-1cb4-4535-a8bf-fe5a80673efb tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-10397921" status: 202 len: 0 microversion: 2.1 time: 0.021691 Aug 31 19:21:49.718887 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 456/916] 10.222.0.65 () {58 vars in 1215 bytes} [Wed Aug 31 19:21:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-10397921 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:21:50.312900 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-f3fb25e0-eccd-4caf-a8a4-5f94c24220f7 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Action: 'create', calling method: .version_select at 0x7fdb89af5940>, body: {"keypair": {"name": "tempest-keypair-1710187437", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEWMogHSD4B5aSu9wLiHaeR++fy+1P3Z9jGkSygWBmp3dQMopzXpSRC7Amm8n3mfrJiIJpmAN7wqbDDCDNGLwdSmauVHY38gvQ6KtD+BmZ6nmBIbnb64j1OmUeA++L1jRA=="}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:21:50.328449 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-f3fb25e0-eccd-4caf-a8a4-5f94c24220f7 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Getting quotas for project e6d782400f1e432c8d10a31334c42e68. Resources: {'key_pairs'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:21:50.332224 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-f3fb25e0-eccd-4caf-a8a4-5f94c24220f7 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Getting quotas for user 0bfa1533b0944bd681f4c2a33cf701b0 and project e6d782400f1e432c8d10a31334c42e68. Resources: {'key_pairs'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:21:50.354334 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-f3fb25e0-eccd-4caf-a8a4-5f94c24220f7 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045417 Aug 31 19:21:50.354912 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 461/917] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Aug 31 19:21:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:21:51.459787 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-c3c2d685-c694-477e-bc82-7a4017eda81a tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:51.460347 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-c3c2d685-c694-477e-bc82-7a4017eda81a tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:51.468486 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c3c2d685-c694-477e-bc82-7a4017eda81a tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:51.469446 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c3c2d685-c694-477e-bc82-7a4017eda81a tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:51.470132 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c3c2d685-c694-477e-bc82-7a4017eda81a tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:51.471077 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c3c2d685-c694-477e-bc82-7a4017eda81a tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:51.471914 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c3c2d685-c694-477e-bc82-7a4017eda81a tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:51.472796 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c3c2d685-c694-477e-bc82-7a4017eda81a tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:51.473687 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-fcf4878e-1586-4593-9736-98c0e942d25d req-68d026db-b6c7-4ff4-a5f7-d7a4cc87f697 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52d843ca-5f08-47f6-98dc-2df1d30438cc", "tag": "4fdbfd0c-e43a-4c2c-ab61-0f67e2dfee09"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:21:51.488305 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-fcf4878e-1586-4593-9736-98c0e942d25d req-68d026db-b6c7-4ff4-a5f7-d7a4cc87f697 service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:51.488781 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-fcf4878e-1586-4593-9736-98c0e942d25d req-68d026db-b6c7-4ff4-a5f7-d7a4cc87f697 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:51.489255 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-fcf4878e-1586-4593-9736-98c0e942d25d req-68d026db-b6c7-4ff4-a5f7-d7a4cc87f697 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:51.504002 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-c3c2d685-c694-477e-bc82-7a4017eda81a tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Going to try to terminate instance {{(pid=120623) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 19:21:51.505644 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-fcf4878e-1586-4593-9736-98c0e942d25d req-68d026db-b6c7-4ff4-a5f7-d7a4cc87f697 service nova] Creating event network-changed:4fdbfd0c-e43a-4c2c-ab61-0f67e2dfee09 for instance 52d843ca-5f08-47f6-98dc-2df1d30438cc on hv-cinder-83538 Aug 31 19:21:51.513324 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-fcf4878e-1586-4593-9736-98c0e942d25d req-68d026db-b6c7-4ff4-a5f7-d7a4cc87f697 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045156 Aug 31 19:21:51.518430 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 462/918] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:21:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:21:51.629570 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-c3c2d685-c694-477e-bc82-7a4017eda81a tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "DELETE /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 204 len: 0 microversion: 2.1 time: 0.174045 Aug 31 19:21:51.630161 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 457/919] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 31 19:21:51 2022] DELETE /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:21:51.639578 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-191793d4-0f97-4173-a293-d88ff538d872 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:51.640272 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-191793d4-0f97-4173-a293-d88ff538d872 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:51.646526 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-191793d4-0f97-4173-a293-d88ff538d872 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:51.647383 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-191793d4-0f97-4173-a293-d88ff538d872 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:51.647880 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-191793d4-0f97-4173-a293-d88ff538d872 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:51.648675 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-191793d4-0f97-4173-a293-d88ff538d872 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:51.649204 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-191793d4-0f97-4173-a293-d88ff538d872 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:51.649703 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-191793d4-0f97-4173-a293-d88ff538d872 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:51.663666 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e45c5981-dd7c-4f0d-a41b-6fa26b31c218 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1169839421", "imageRef": "f4f2ae76-bacc-4449-881b-f697e1eeec66", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3d3f0557-9886-408b-a53b-c6736a0907d4"}], "security_groups": [{"name": "tempest-securitygroup--271964950"}], "key_name": "tempest-keypair-1710187437", "user_data": "}} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:21:51.782660 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.network.neutron [None req-e45c5981-dd7c-4f0d-a41b-6fa26b31c218 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] validate_networks() for [('3d3f0557-9886-408b-a53b-c6736a0907d4', None, None, None, None, None)] {{(pid=120623) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:21:51.795370 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-191793d4-0f97-4173-a293-d88ff538d872 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:51.804219 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-191793d4-0f97-4173-a293-d88ff538d872 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1568 microversion: 2.1 time: 0.168762 Aug 31 19:21:51.804457 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 463/920] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:51 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:52.157967 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-e45c5981-dd7c-4f0d-a41b-6fa26b31c218 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Flavor limits 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:21:52.158393 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-e45c5981-dd7c-4f0d-a41b-6fa26b31c218 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Image limits 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:21:52.159124 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-e45c5981-dd7c-4f0d-a41b-6fa26b31c218 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Flavor pref 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:21:52.159263 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-e45c5981-dd7c-4f0d-a41b-6fa26b31c218 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Image pref 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:21:52.159816 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-e45c5981-dd7c-4f0d-a41b-6fa26b31c218 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:21:52.169302 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e45c5981-dd7c-4f0d-a41b-6fa26b31c218 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:52.169979 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e45c5981-dd7c-4f0d-a41b-6fa26b31c218 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:52.170419 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e45c5981-dd7c-4f0d-a41b-6fa26b31c218 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:52.171149 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e45c5981-dd7c-4f0d-a41b-6fa26b31c218 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:52.171636 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e45c5981-dd7c-4f0d-a41b-6fa26b31c218 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:52.172057 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e45c5981-dd7c-4f0d-a41b-6fa26b31c218 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:52.189661 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.quota [None req-e45c5981-dd7c-4f0d-a41b-6fa26b31c218 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Getting quotas for project e6d782400f1e432c8d10a31334c42e68. Resources: {'instances', 'cores', 'ram'} {{(pid=120623) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:21:52.193818 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.quota [None req-e45c5981-dd7c-4f0d-a41b-6fa26b31c218 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Getting quotas for user 0bfa1533b0944bd681f4c2a33cf701b0 and project e6d782400f1e432c8d10a31334c42e68. Resources: {'instances', 'cores', 'ram'} {{(pid=120623) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:21:52.206278 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-e45c5981-dd7c-4f0d-a41b-6fa26b31c218 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Going to run 1 instances... {{(pid=120623) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:21:52.208725 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-e45c5981-dd7c-4f0d-a41b-6fa26b31c218 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: db83c2c0-f1c0-40e5-9d61-11a89b10bab6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f4f2ae76-bacc-4449-881b-f697e1eeec66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120623) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:21:52.261209 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-e45c5981-dd7c-4f0d-a41b-6fa26b31c218 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.602566 Aug 31 19:21:52.263586 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 458/921] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 31 19:21:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 19:21:52.273106 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-88c5ba94-87cd-45ce-89c3-6893face3b51 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:52.273751 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-88c5ba94-87cd-45ce-89c3-6893face3b51 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: db83c2c0-f1c0-40e5-9d61-11a89b10bab6] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:52.344674 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-88c5ba94-87cd-45ce-89c3-6893face3b51 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:52.352946 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-88c5ba94-87cd-45ce-89c3-6893face3b51 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/db83c2c0-f1c0-40e5-9d61-11a89b10bab6" status: 200 len: 1242 microversion: 2.1 time: 0.083687 Aug 31 19:21:52.365245 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 464/922] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:52 2022] GET /compute/v2.1/servers/db83c2c0-f1c0-40e5-9d61-11a89b10bab6 => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:52.829650 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-ce40bc15-570f-4ee4-a8a7-3a362fb3a98c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:52.830895 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-ce40bc15-570f-4ee4-a8a7-3a362fb3a98c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:52.838698 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ce40bc15-570f-4ee4-a8a7-3a362fb3a98c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:52.839185 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ce40bc15-570f-4ee4-a8a7-3a362fb3a98c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:52.840135 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ce40bc15-570f-4ee4-a8a7-3a362fb3a98c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:52.840821 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ce40bc15-570f-4ee4-a8a7-3a362fb3a98c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:52.841302 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ce40bc15-570f-4ee4-a8a7-3a362fb3a98c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:52.841724 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ce40bc15-570f-4ee4-a8a7-3a362fb3a98c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:52.999965 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-ce40bc15-570f-4ee4-a8a7-3a362fb3a98c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:53.007701 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-ce40bc15-570f-4ee4-a8a7-3a362fb3a98c tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1568 microversion: 2.1 time: 0.184296 Aug 31 19:21:53.008315 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 459/923] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:52 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1568 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:21:53.377504 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-e554349e-d169-4c7f-bee4-2620213c51f2 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:53.378164 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-e554349e-d169-4c7f-bee4-2620213c51f2 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: db83c2c0-f1c0-40e5-9d61-11a89b10bab6] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:53.384618 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e554349e-d169-4c7f-bee4-2620213c51f2 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:53.385101 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e554349e-d169-4c7f-bee4-2620213c51f2 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:53.385574 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e554349e-d169-4c7f-bee4-2620213c51f2 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:53.386266 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e554349e-d169-4c7f-bee4-2620213c51f2 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:53.387211 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e554349e-d169-4c7f-bee4-2620213c51f2 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:53.387631 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e554349e-d169-4c7f-bee4-2620213c51f2 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:53.450912 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-e554349e-d169-4c7f-bee4-2620213c51f2 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:53.458878 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-e554349e-d169-4c7f-bee4-2620213c51f2 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/db83c2c0-f1c0-40e5-9d61-11a89b10bab6" status: 200 len: 1294 microversion: 2.1 time: 0.085079 Aug 31 19:21:53.459469 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 465/924] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:53 2022] GET /compute/v2.1/servers/db83c2c0-f1c0-40e5-9d61-11a89b10bab6 => generated 1294 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:54.029545 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-96285239-2482-4dcf-845b-f9951bcbd8a2 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:54.030294 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-96285239-2482-4dcf-845b-f9951bcbd8a2 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:54.037976 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-96285239-2482-4dcf-845b-f9951bcbd8a2 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:54.038472 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-96285239-2482-4dcf-845b-f9951bcbd8a2 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:54.038908 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-96285239-2482-4dcf-845b-f9951bcbd8a2 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:54.039613 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-96285239-2482-4dcf-845b-f9951bcbd8a2 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:54.040058 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-96285239-2482-4dcf-845b-f9951bcbd8a2 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:54.041280 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-96285239-2482-4dcf-845b-f9951bcbd8a2 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:54.248120 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-96285239-2482-4dcf-845b-f9951bcbd8a2 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:54.256180 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-96285239-2482-4dcf-845b-f9951bcbd8a2 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1449 microversion: 2.1 time: 0.230388 Aug 31 19:21:54.257045 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 460/925] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:54 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1449 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:54.415538 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-ba5d64d5-a139-4fe0-9f97-c005cdf1201e req-5cc80715-74d8-41fb-a87c-440a39141c85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52d843ca-5f08-47f6-98dc-2df1d30438cc", "name": "network-vif-deleted", "tag": "4fdbfd0c-e43a-4c2c-ab61-0f67e2dfee09"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:21:54.428015 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-ba5d64d5-a139-4fe0-9f97-c005cdf1201e req-5cc80715-74d8-41fb-a87c-440a39141c85 service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:54.428491 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-ba5d64d5-a139-4fe0-9f97-c005cdf1201e req-5cc80715-74d8-41fb-a87c-440a39141c85 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:54.428912 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-ba5d64d5-a139-4fe0-9f97-c005cdf1201e req-5cc80715-74d8-41fb-a87c-440a39141c85 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:54.440976 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-ba5d64d5-a139-4fe0-9f97-c005cdf1201e req-5cc80715-74d8-41fb-a87c-440a39141c85 service nova] Creating event network-vif-deleted:4fdbfd0c-e43a-4c2c-ab61-0f67e2dfee09 for instance 52d843ca-5f08-47f6-98dc-2df1d30438cc on hv-cinder-83538 Aug 31 19:21:54.446779 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-ba5d64d5-a139-4fe0-9f97-c005cdf1201e req-5cc80715-74d8-41fb-a87c-440a39141c85 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035851 Aug 31 19:21:54.447376 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 466/926] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:21:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:21:54.483004 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-ba01d04e-44e9-419e-8caf-9bdf8add7bec tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:54.485279 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-ba01d04e-44e9-419e-8caf-9bdf8add7bec tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: db83c2c0-f1c0-40e5-9d61-11a89b10bab6] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:54.492423 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ba01d04e-44e9-419e-8caf-9bdf8add7bec tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:54.492963 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ba01d04e-44e9-419e-8caf-9bdf8add7bec tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:54.493970 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ba01d04e-44e9-419e-8caf-9bdf8add7bec tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:54.494708 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ba01d04e-44e9-419e-8caf-9bdf8add7bec tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:54.495557 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ba01d04e-44e9-419e-8caf-9bdf8add7bec tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:54.496023 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ba01d04e-44e9-419e-8caf-9bdf8add7bec tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:54.642620 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-ba01d04e-44e9-419e-8caf-9bdf8add7bec tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:54.655686 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-ba01d04e-44e9-419e-8caf-9bdf8add7bec tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/db83c2c0-f1c0-40e5-9d61-11a89b10bab6" status: 200 len: 1367 microversion: 2.1 time: 0.178133 Aug 31 19:21:54.656323 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 461/927] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:54 2022] GET /compute/v2.1/servers/db83c2c0-f1c0-40e5-9d61-11a89b10bab6 => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:55.279297 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-ab7aac86-5b0a-4932-ad06-a5db69e08d48 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:55.280175 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-ab7aac86-5b0a-4932-ad06-a5db69e08d48 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:55.286381 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ab7aac86-5b0a-4932-ad06-a5db69e08d48 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:55.286861 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ab7aac86-5b0a-4932-ad06-a5db69e08d48 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:55.287286 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ab7aac86-5b0a-4932-ad06-a5db69e08d48 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:55.287976 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ab7aac86-5b0a-4932-ad06-a5db69e08d48 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:55.288423 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ab7aac86-5b0a-4932-ad06-a5db69e08d48 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:55.288888 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ab7aac86-5b0a-4932-ad06-a5db69e08d48 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:55.325421 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ab7aac86-5b0a-4932-ad06-a5db69e08d48 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:55.325952 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ab7aac86-5b0a-4932-ad06-a5db69e08d48 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:55.326562 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ab7aac86-5b0a-4932-ad06-a5db69e08d48 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:55.327251 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.objects.instance [None req-ab7aac86-5b0a-4932-ad06-a5db69e08d48 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lazy-loading 'fault' on Instance uuid 52d843ca-5f08-47f6-98dc-2df1d30438cc {{(pid=120624) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:21:55.386838 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-96e098e9-1d4a-4e4a-a16b-7a227fcb03e8 req-8005bd48-50f7-453a-b4e0-73da5f058476 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db83c2c0-f1c0-40e5-9d61-11a89b10bab6", "tag": "202c471d-0cc7-4090-80ac-2d7ff7c4ea26"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:21:55.400033 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-ab7aac86-5b0a-4932-ad06-a5db69e08d48 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26cd75e2c118412a88bb354e18863d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3b687e68734a8888291f0c3527acbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:55.407659 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-96e098e9-1d4a-4e4a-a16b-7a227fcb03e8 req-8005bd48-50f7-453a-b4e0-73da5f058476 service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:55.408544 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-96e098e9-1d4a-4e4a-a16b-7a227fcb03e8 req-8005bd48-50f7-453a-b4e0-73da5f058476 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:55.409132 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-96e098e9-1d4a-4e4a-a16b-7a227fcb03e8 req-8005bd48-50f7-453a-b4e0-73da5f058476 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:55.414115 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-ab7aac86-5b0a-4932-ad06-a5db69e08d48 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 200 len: 1223 microversion: 2.1 time: 0.140012 Aug 31 19:21:55.415584 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 467/928] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:55 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 1223 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:55.426452 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-96e098e9-1d4a-4e4a-a16b-7a227fcb03e8 req-8005bd48-50f7-453a-b4e0-73da5f058476 service nova] Creating event network-changed:202c471d-0cc7-4090-80ac-2d7ff7c4ea26 for instance db83c2c0-f1c0-40e5-9d61-11a89b10bab6 on hv-cinder-83538 Aug 31 19:21:55.433891 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-96e098e9-1d4a-4e4a-a16b-7a227fcb03e8 req-8005bd48-50f7-453a-b4e0-73da5f058476 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052159 Aug 31 19:21:55.434712 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 462/929] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:21:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:21:55.679898 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-afb7b294-6f8e-48de-b487-0609c0377e76 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:55.680497 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-afb7b294-6f8e-48de-b487-0609c0377e76 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: db83c2c0-f1c0-40e5-9d61-11a89b10bab6] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:55.686862 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-afb7b294-6f8e-48de-b487-0609c0377e76 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:55.687341 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-afb7b294-6f8e-48de-b487-0609c0377e76 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:55.687770 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-afb7b294-6f8e-48de-b487-0609c0377e76 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:55.688448 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-afb7b294-6f8e-48de-b487-0609c0377e76 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:55.688888 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-afb7b294-6f8e-48de-b487-0609c0377e76 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:55.689325 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-afb7b294-6f8e-48de-b487-0609c0377e76 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:55.892772 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-afb7b294-6f8e-48de-b487-0609c0377e76 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:55.900358 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-afb7b294-6f8e-48de-b487-0609c0377e76 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/db83c2c0-f1c0-40e5-9d61-11a89b10bab6" status: 200 len: 1367 microversion: 2.1 time: 0.224289 Aug 31 19:21:55.900924 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 468/930] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:55 2022] GET /compute/v2.1/servers/db83c2c0-f1c0-40e5-9d61-11a89b10bab6 => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:56.440185 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-0c95597a-9f76-4bcf-a609-588c035f5aa7 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:56.440876 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-0c95597a-9f76-4bcf-a609-588c035f5aa7 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] [instance: 52d843ca-5f08-47f6-98dc-2df1d30438cc] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:56.447000 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0c95597a-9f76-4bcf-a609-588c035f5aa7 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:56.447403 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0c95597a-9f76-4bcf-a609-588c035f5aa7 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:56.447828 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0c95597a-9f76-4bcf-a609-588c035f5aa7 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:56.448497 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0c95597a-9f76-4bcf-a609-588c035f5aa7 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:56.448942 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0c95597a-9f76-4bcf-a609-588c035f5aa7 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:56.449385 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0c95597a-9f76-4bcf-a609-588c035f5aa7 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:56.464086 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.wsgi [None req-0c95597a-9f76-4bcf-a609-588c035f5aa7 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] HTTP exception thrown: Instance 52d843ca-5f08-47f6-98dc-2df1d30438cc could not be found. Aug 31 19:21:56.465713 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-0c95597a-9f76-4bcf-a609-588c035f5aa7 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Request method failure captured: Aug 31 19:21:56.465713 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: request: GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc HTTP/1.1 Aug 31 19:21:56.465713 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Accept: application/json Aug 31 19:21:56.465713 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Accept-Encoding: identity Aug 31 19:21:56.465713 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Connection: close Aug 31 19:21:56.465713 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Content-Length: 0 Aug 31 19:21:56.465713 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Content-Type: application/json Aug 31 19:21:56.465713 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Host: 10.222.0.65 Aug 31 19:21:56.465713 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Openstack-System-Scope: None Aug 31 19:21:56.465713 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: User-Agent: python-urllib3/1.26.12 Aug 31 19:21:56.465713 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Auth-Token: gAAAAABjD7MQzryIWq--k972H-sKd7ksUvSYft_29XyWXbpd85dtDs_KSVgCvBr4ijL5s5M1EoK7SnAJzGGBnBQZOyg1KvcCwX0FSHrT7n22G9iEJqD7CwCzw0kc4MztEA06iZZ8z27wstDOyABCiT3dLAQQ2qP8u9xqZrkGkg5HWD89uV0oPJI Aug 31 19:21:56.465713 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Domain-Id: None Aug 31 19:21:56.465713 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Domain-Name: None Aug 31 19:21:56.465713 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Identity-Status: Confirmed Aug 31 19:21:56.465713 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Is-Admin-Project: True Aug 31 19:21:56.465713 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Id: default Aug 31 19:21:56.465713 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Name: Default Aug 31 19:21:56.465713 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Id: fe3b687e68734a8888291f0c3527acbc Aug 31 19:21:56.465713 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Name: tempest-TestShelveInstance-1350555328 Aug 31 19:21:56.465713 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Role: member,reader Aug 31 19:21:56.465713 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Roles: member,reader Aug 31 19:21:56.467341 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/fe3b687e68734a8888291f0c3527acbc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/fe3b687e68734a8888291f0c3527acbc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_fe3b687e68734a8888291f0c3527acbc", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/fe3b687e68734a8888291f0c3527acbc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:21:56.467341 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant: tempest-TestShelveInstance-1350555328 Aug 31 19:21:56.467341 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant-Id: fe3b687e68734a8888291f0c3527acbc Aug 31 19:21:56.467341 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant-Name: tempest-TestShelveInstance-1350555328 Aug 31 19:21:56.467341 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User: tempest-TestShelveInstance-1350555328-project Aug 31 19:21:56.467341 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Id: default Aug 31 19:21:56.467341 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Name: Default Aug 31 19:21:56.467341 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Id: 26cd75e2c118412a88bb354e18863d34 Aug 31 19:21:56.467341 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Name: tempest-TestShelveInstance-1350555328-project Aug 31 19:21:56.467341 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: method: > Aug 31 19:21:56.467341 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: exception: Instance 52d843ca-5f08-47f6-98dc-2df1d30438cc could not be found. Aug 31 19:21:56.467341 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: action_args: {'id': '52d843ca-5f08-47f6-98dc-2df1d30438cc'} Aug 31 19:21:56.468429 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:21:56.468429 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:21:56.468429 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:21:56.468429 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:21:56.468429 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:21:56.468429 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:21:56.468429 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:21:56.468429 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:21:56.468429 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:21:56.468429 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:21:56.468429 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52d843ca-5f08-47f6-98dc-2df1d30438cc could not be found. Aug 31 19:21:56.468429 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:21:56.468429 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:21:56.468429 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:21:56.468429 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:21:56.468429 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:21:56.468429 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:21:56.468429 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:21:56.468429 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:21:56.468429 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:21:56.469998 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:21:56.469998 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:21:56.469998 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:21:56.469998 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:21:56.469998 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:21:56.469998 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:21:56.469998 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:21:56.469998 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52d843ca-5f08-47f6-98dc-2df1d30438cc could not be found. Aug 31 19:21:56.469998 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:21:56.469998 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:21:56.469998 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:21:56.469998 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:21:56.469998 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:21:56.469998 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:21:56.469998 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:21:56.469998 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:21:56.469998 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52d843ca-5f08-47f6-98dc-2df1d30438cc could not be found. Aug 31 19:21:56.469998 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:21:56.471653 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-0c95597a-9f76-4bcf-a609-588c035f5aa7 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Returning 404 to user: Instance 52d843ca-5f08-47f6-98dc-2df1d30438cc could not be found. {{(pid=120623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:21:56.471653 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-0c95597a-9f76-4bcf-a609-588c035f5aa7 tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc" status: 404 len: 111 microversion: 2.1 time: 0.031532 Aug 31 19:21:56.471653 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 463/931] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:56 2022] GET /compute/v2.1/servers/52d843ca-5f08-47f6-98dc-2df1d30438cc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:21:56.627490 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-19f8f03e-ca9d-44c4-81d3-bd0214d7295f tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] Calling method '.version_select at 0x7fdb89ba5670>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:56.648126 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-19f8f03e-ca9d-44c4-81d3-bd0214d7295f tempest-TestShelveInstance-1350555328 tempest-TestShelveInstance-1350555328-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1231074008" status: 202 len: 0 microversion: 2.1 time: 0.024621 Aug 31 19:21:56.648710 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 469/932] 10.222.0.65 () {58 vars in 1254 bytes} [Wed Aug 31 19:21:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1231074008 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 19:21:56.921394 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-cbc9a694-f157-4218-bbee-a8bc00135cfa tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:56.922123 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-cbc9a694-f157-4218-bbee-a8bc00135cfa tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: db83c2c0-f1c0-40e5-9d61-11a89b10bab6] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:56.928048 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cbc9a694-f157-4218-bbee-a8bc00135cfa tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:56.928608 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cbc9a694-f157-4218-bbee-a8bc00135cfa tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:56.929110 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cbc9a694-f157-4218-bbee-a8bc00135cfa tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:56.929912 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cbc9a694-f157-4218-bbee-a8bc00135cfa tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:56.930436 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cbc9a694-f157-4218-bbee-a8bc00135cfa tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:56.930864 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cbc9a694-f157-4218-bbee-a8bc00135cfa tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:57.131231 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-cbc9a694-f157-4218-bbee-a8bc00135cfa tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:57.139532 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-cbc9a694-f157-4218-bbee-a8bc00135cfa tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/db83c2c0-f1c0-40e5-9d61-11a89b10bab6" status: 200 len: 1367 microversion: 2.1 time: 0.222867 Aug 31 19:21:57.140097 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 464/933] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:56 2022] GET /compute/v2.1/servers/db83c2c0-f1c0-40e5-9d61-11a89b10bab6 => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:58.161748 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-817a53de-c738-4c8c-9bdd-a815c4c451f9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:58.162424 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-817a53de-c738-4c8c-9bdd-a815c4c451f9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: db83c2c0-f1c0-40e5-9d61-11a89b10bab6] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:58.169542 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-817a53de-c738-4c8c-9bdd-a815c4c451f9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:58.170049 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-817a53de-c738-4c8c-9bdd-a815c4c451f9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:58.170478 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-817a53de-c738-4c8c-9bdd-a815c4c451f9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:58.171183 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-817a53de-c738-4c8c-9bdd-a815c4c451f9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:58.171636 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-817a53de-c738-4c8c-9bdd-a815c4c451f9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:58.172057 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-817a53de-c738-4c8c-9bdd-a815c4c451f9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:58.488941 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-817a53de-c738-4c8c-9bdd-a815c4c451f9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:58.497839 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-817a53de-c738-4c8c-9bdd-a815c4c451f9 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/db83c2c0-f1c0-40e5-9d61-11a89b10bab6" status: 200 len: 1367 microversion: 2.1 time: 0.341575 Aug 31 19:21:58.498952 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 470/934] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:58 2022] GET /compute/v2.1/servers/db83c2c0-f1c0-40e5-9d61-11a89b10bab6 => generated 1367 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:59.519411 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-31712feb-da74-4335-a1c1-9fdfca2a795b tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:59.520038 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-31712feb-da74-4335-a1c1-9fdfca2a795b tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: db83c2c0-f1c0-40e5-9d61-11a89b10bab6] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:59.537806 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-31712feb-da74-4335-a1c1-9fdfca2a795b tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:59.538365 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-31712feb-da74-4335-a1c1-9fdfca2a795b tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:59.539265 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-31712feb-da74-4335-a1c1-9fdfca2a795b tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:59.540139 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-31712feb-da74-4335-a1c1-9fdfca2a795b tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:59.540761 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-31712feb-da74-4335-a1c1-9fdfca2a795b tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:59.544767 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-31712feb-da74-4335-a1c1-9fdfca2a795b tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:59.569559 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:59.713542 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-31712feb-da74-4335-a1c1-9fdfca2a795b tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:59.722309 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-31712feb-da74-4335-a1c1-9fdfca2a795b tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/db83c2c0-f1c0-40e5-9d61-11a89b10bab6" status: 200 len: 1367 microversion: 2.1 time: 0.206847 Aug 31 19:21:59.723223 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 465/935] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:59 2022] GET /compute/v2.1/servers/db83c2c0-f1c0-40e5-9d61-11a89b10bab6 => generated 1367 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:00.743273 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-0ca1822b-67c6-4c6d-aee9-5c2e0f5ac3f0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:00.743887 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-0ca1822b-67c6-4c6d-aee9-5c2e0f5ac3f0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: db83c2c0-f1c0-40e5-9d61-11a89b10bab6] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:00.750451 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0ca1822b-67c6-4c6d-aee9-5c2e0f5ac3f0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:00.750966 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0ca1822b-67c6-4c6d-aee9-5c2e0f5ac3f0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:00.751425 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0ca1822b-67c6-4c6d-aee9-5c2e0f5ac3f0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:00.752140 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0ca1822b-67c6-4c6d-aee9-5c2e0f5ac3f0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:00.752590 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0ca1822b-67c6-4c6d-aee9-5c2e0f5ac3f0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:00.753004 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0ca1822b-67c6-4c6d-aee9-5c2e0f5ac3f0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:00.900255 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-0ca1822b-67c6-4c6d-aee9-5c2e0f5ac3f0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:00.910775 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-0ca1822b-67c6-4c6d-aee9-5c2e0f5ac3f0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/db83c2c0-f1c0-40e5-9d61-11a89b10bab6" status: 200 len: 1367 microversion: 2.1 time: 0.171241 Aug 31 19:22:00.911462 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 471/936] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:00 2022] GET /compute/v2.1/servers/db83c2c0-f1c0-40e5-9d61-11a89b10bab6 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:01.932201 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-b4ddb3cb-f397-4a33-ba27-781976c9504b tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:01.933970 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-b4ddb3cb-f397-4a33-ba27-781976c9504b tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: db83c2c0-f1c0-40e5-9d61-11a89b10bab6] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:01.940658 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b4ddb3cb-f397-4a33-ba27-781976c9504b tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:01.941142 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b4ddb3cb-f397-4a33-ba27-781976c9504b tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:01.942017 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b4ddb3cb-f397-4a33-ba27-781976c9504b tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:01.942709 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b4ddb3cb-f397-4a33-ba27-781976c9504b tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:01.943684 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b4ddb3cb-f397-4a33-ba27-781976c9504b tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:01.944327 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b4ddb3cb-f397-4a33-ba27-781976c9504b tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:02.179911 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell0:SELECT=2 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:22:02.185773 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-b4ddb3cb-f397-4a33-ba27-781976c9504b tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:02.195351 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-b4ddb3cb-f397-4a33-ba27-781976c9504b tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/db83c2c0-f1c0-40e5-9d61-11a89b10bab6" status: 200 len: 1367 microversion: 2.1 time: 0.267339 Aug 31 19:22:02.209127 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 466/937] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:01 2022] GET /compute/v2.1/servers/db83c2c0-f1c0-40e5-9d61-11a89b10bab6 => generated 1367 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:03.217114 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-d18d0d58-cbb1-43ac-86d6-24bd8f0707b0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:03.218570 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-d18d0d58-cbb1-43ac-86d6-24bd8f0707b0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: db83c2c0-f1c0-40e5-9d61-11a89b10bab6] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:03.223409 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell0:SELECT=6 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:22:03.228313 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d18d0d58-cbb1-43ac-86d6-24bd8f0707b0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:03.229075 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d18d0d58-cbb1-43ac-86d6-24bd8f0707b0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:03.229760 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d18d0d58-cbb1-43ac-86d6-24bd8f0707b0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:03.231120 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d18d0d58-cbb1-43ac-86d6-24bd8f0707b0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:03.231796 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d18d0d58-cbb1-43ac-86d6-24bd8f0707b0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:03.232579 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d18d0d58-cbb1-43ac-86d6-24bd8f0707b0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:03.335255 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-a486f558-2ef1-46fd-aff5-5a2d1daff02b req-a75da03c-2c4c-46e8-ba2c-52380731158d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db83c2c0-f1c0-40e5-9d61-11a89b10bab6", "name": "network-vif-plugged", "status": "completed", "tag": "202c471d-0cc7-4090-80ac-2d7ff7c4ea26"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:22:03.342501 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell0:SELECT=6 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:22:03.349380 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-a486f558-2ef1-46fd-aff5-5a2d1daff02b req-a75da03c-2c4c-46e8-ba2c-52380731158d service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:03.350147 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-a486f558-2ef1-46fd-aff5-5a2d1daff02b req-a75da03c-2c4c-46e8-ba2c-52380731158d service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:03.350857 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-a486f558-2ef1-46fd-aff5-5a2d1daff02b req-a75da03c-2c4c-46e8-ba2c-52380731158d service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:03.364571 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-a486f558-2ef1-46fd-aff5-5a2d1daff02b req-a75da03c-2c4c-46e8-ba2c-52380731158d service nova] Creating event network-vif-plugged:202c471d-0cc7-4090-80ac-2d7ff7c4ea26 for instance db83c2c0-f1c0-40e5-9d61-11a89b10bab6 on hv-cinder-83538 Aug 31 19:22:03.370060 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-a486f558-2ef1-46fd-aff5-5a2d1daff02b req-a75da03c-2c4c-46e8-ba2c-52380731158d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038688 Aug 31 19:22:03.371760 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 467/938] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:22:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:22:03.515036 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-d18d0d58-cbb1-43ac-86d6-24bd8f0707b0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:03.523437 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-d18d0d58-cbb1-43ac-86d6-24bd8f0707b0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/db83c2c0-f1c0-40e5-9d61-11a89b10bab6" status: 200 len: 1367 microversion: 2.1 time: 0.311239 Aug 31 19:22:03.524100 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 472/939] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:03 2022] GET /compute/v2.1/servers/db83c2c0-f1c0-40e5-9d61-11a89b10bab6 => generated 1367 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:04.545602 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d1e0eea4-6127-469b-b763-fdbef16e4d84 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:04.546434 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d1e0eea4-6127-469b-b763-fdbef16e4d84 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: db83c2c0-f1c0-40e5-9d61-11a89b10bab6] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:04.553386 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d1e0eea4-6127-469b-b763-fdbef16e4d84 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:04.553894 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d1e0eea4-6127-469b-b763-fdbef16e4d84 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:04.554323 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d1e0eea4-6127-469b-b763-fdbef16e4d84 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:04.555048 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d1e0eea4-6127-469b-b763-fdbef16e4d84 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:04.555494 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d1e0eea4-6127-469b-b763-fdbef16e4d84 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:04.555932 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d1e0eea4-6127-469b-b763-fdbef16e4d84 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:04.701539 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-d1e0eea4-6127-469b-b763-fdbef16e4d84 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:04.709162 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-d1e0eea4-6127-469b-b763-fdbef16e4d84 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/db83c2c0-f1c0-40e5-9d61-11a89b10bab6" status: 200 len: 1367 microversion: 2.1 time: 0.168744 Aug 31 19:22:04.709742 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 468/940] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:04 2022] GET /compute/v2.1/servers/db83c2c0-f1c0-40e5-9d61-11a89b10bab6 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:05.731094 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-e6acbe08-4633-40a6-b0be-5b670ff1fedb tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:05.731739 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-e6acbe08-4633-40a6-b0be-5b670ff1fedb tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: db83c2c0-f1c0-40e5-9d61-11a89b10bab6] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:05.734143 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:22:05.739358 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e6acbe08-4633-40a6-b0be-5b670ff1fedb tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:05.739837 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e6acbe08-4633-40a6-b0be-5b670ff1fedb tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:05.740264 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e6acbe08-4633-40a6-b0be-5b670ff1fedb tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:05.740944 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e6acbe08-4633-40a6-b0be-5b670ff1fedb tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:05.741422 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e6acbe08-4633-40a6-b0be-5b670ff1fedb tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:05.741840 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e6acbe08-4633-40a6-b0be-5b670ff1fedb tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:05.746362 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:22:06.066575 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-e6acbe08-4633-40a6-b0be-5b670ff1fedb tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:06.075338 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-e6acbe08-4633-40a6-b0be-5b670ff1fedb tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/db83c2c0-f1c0-40e5-9d61-11a89b10bab6" status: 200 len: 1557 microversion: 2.1 time: 0.347653 Aug 31 19:22:06.076548 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 473/941] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:05 2022] GET /compute/v2.1/servers/db83c2c0-f1c0-40e5-9d61-11a89b10bab6 => generated 1557 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:06.096291 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-a10bab8e-0824-462a-ba90-b2cda76a4d4e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:06.097069 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-a10bab8e-0824-462a-ba90-b2cda76a4d4e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: db83c2c0-f1c0-40e5-9d61-11a89b10bab6] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:06.099459 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:22:06.104969 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a10bab8e-0824-462a-ba90-b2cda76a4d4e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:06.105568 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a10bab8e-0824-462a-ba90-b2cda76a4d4e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:06.106005 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a10bab8e-0824-462a-ba90-b2cda76a4d4e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:06.106749 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a10bab8e-0824-462a-ba90-b2cda76a4d4e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:06.107202 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a10bab8e-0824-462a-ba90-b2cda76a4d4e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:06.107624 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a10bab8e-0824-462a-ba90-b2cda76a4d4e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:06.184553 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-a10bab8e-0824-462a-ba90-b2cda76a4d4e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/db83c2c0-f1c0-40e5-9d61-11a89b10bab6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092083 Aug 31 19:22:06.185139 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 469/942] 10.222.0.65 () {58 vars in 1275 bytes} [Wed Aug 31 19:22:06 2022] GET /compute/v2.1/servers/db83c2c0-f1c0-40e5-9d61-11a89b10bab6/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:22:07.089584 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-2985eee2-6b0b-48e1-99a8-cace5fe467fb req-82add75d-3953-4796-b621-ffbf5255e38a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db83c2c0-f1c0-40e5-9d61-11a89b10bab6", "tag": "202c471d-0cc7-4090-80ac-2d7ff7c4ea26"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:22:07.099471 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-2985eee2-6b0b-48e1-99a8-cace5fe467fb req-82add75d-3953-4796-b621-ffbf5255e38a service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:07.099931 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-2985eee2-6b0b-48e1-99a8-cace5fe467fb req-82add75d-3953-4796-b621-ffbf5255e38a service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:07.100355 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-2985eee2-6b0b-48e1-99a8-cace5fe467fb req-82add75d-3953-4796-b621-ffbf5255e38a service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:07.111699 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-2985eee2-6b0b-48e1-99a8-cace5fe467fb req-82add75d-3953-4796-b621-ffbf5255e38a service nova] Creating event network-changed:202c471d-0cc7-4090-80ac-2d7ff7c4ea26 for instance db83c2c0-f1c0-40e5-9d61-11a89b10bab6 on hv-cinder-83538 Aug 31 19:22:07.116604 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-2985eee2-6b0b-48e1-99a8-cace5fe467fb req-82add75d-3953-4796-b621-ffbf5255e38a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030695 Aug 31 19:22:07.117234 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 474/943] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:22:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:22:39.065537 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=20 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:22:39.066189 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=1 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:22:39.071025 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-a40f92a3-91b3-47e8-bca4-df6d5c35e44f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:39.071507 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-a40f92a3-91b3-47e8-bca4-df6d5c35e44f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:39.079155 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a40f92a3-91b3-47e8-bca4-df6d5c35e44f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:39.079643 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a40f92a3-91b3-47e8-bca4-df6d5c35e44f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:39.080188 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a40f92a3-91b3-47e8-bca4-df6d5c35e44f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:39.080915 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a40f92a3-91b3-47e8-bca4-df6d5c35e44f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:39.081419 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a40f92a3-91b3-47e8-bca4-df6d5c35e44f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:39.081852 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a40f92a3-91b3-47e8-bca4-df6d5c35e44f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:39.106320 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-a40f92a3-91b3-47e8-bca4-df6d5c35e44f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05/ips" status: 200 len: 152 microversion: 2.20 time: 0.042410 Aug 31 19:22:39.107017 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 470/944] 10.222.0.65 () {60 vars in 1289 bytes} [Wed Aug 31 19:22:39 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05/ips => generated 152 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 19:22:40.914228 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_api:SELECT=3 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:22:40.914952 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=7 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:22:40.916304 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 19:22:40.916464 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Wed Aug 31 19:22:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05/action (ip 10.222.0.65) !!! Aug 31 19:22:40.921311 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-7416dbe5-c8a8-44b0-9ef0-f86531d772dc tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:22:40.921928 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-7416dbe5-c8a8-44b0-9ef0-f86531d772dc tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:40.931179 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7416dbe5-c8a8-44b0-9ef0-f86531d772dc tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:40.931665 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7416dbe5-c8a8-44b0-9ef0-f86531d772dc tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:40.932095 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7416dbe5-c8a8-44b0-9ef0-f86531d772dc tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:40.932782 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7416dbe5-c8a8-44b0-9ef0-f86531d772dc tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:40.933266 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7416dbe5-c8a8-44b0-9ef0-f86531d772dc tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:40.933691 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7416dbe5-c8a8-44b0-9ef0-f86531d772dc tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:40.956456 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.objects.instance [None req-7416dbe5-c8a8-44b0-9ef0-f86531d772dc tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lazy-loading 'flavor' on Instance uuid 5ff90966-a8dd-41ae-848d-e155bf217b05 {{(pid=120624) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:22:41.138655 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-7416dbe5-c8a8-44b0-9ef0-f86531d772dc tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "POST /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05/action" status: 202 len: 0 microversion: 2.20 time: 0.225782 Aug 31 19:22:41.139242 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 475/945] 10.222.0.65 () {62 vars in 1319 bytes} [Wed Aug 31 19:22:40 2022] POST /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:22:41.147467 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-b9fcbb8a-e821-4fee-896a-b270a0233fa9 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:41.148075 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-b9fcbb8a-e821-4fee-896a-b270a0233fa9 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:41.155005 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b9fcbb8a-e821-4fee-896a-b270a0233fa9 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:41.155488 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b9fcbb8a-e821-4fee-896a-b270a0233fa9 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:41.155923 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b9fcbb8a-e821-4fee-896a-b270a0233fa9 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:41.156609 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b9fcbb8a-e821-4fee-896a-b270a0233fa9 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:41.157072 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b9fcbb8a-e821-4fee-896a-b270a0233fa9 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:41.157509 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b9fcbb8a-e821-4fee-896a-b270a0233fa9 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:41.344815 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-b9fcbb8a-e821-4fee-896a-b270a0233fa9 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:41.353254 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-b9fcbb8a-e821-4fee-896a-b270a0233fa9 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:41.354692 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-b9fcbb8a-e821-4fee-896a-b270a0233fa9 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:41.355838 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-b9fcbb8a-e821-4fee-896a-b270a0233fa9 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1721 microversion: 2.20 time: 0.212267 Aug 31 19:22:41.356411 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 471/946] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:22:41 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1721 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:22:42.379993 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-db0ec7fd-1536-4bac-9910-7692fbd557ed tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:42.380613 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-db0ec7fd-1536-4bac-9910-7692fbd557ed tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:42.388514 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-db0ec7fd-1536-4bac-9910-7692fbd557ed tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:42.388998 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-db0ec7fd-1536-4bac-9910-7692fbd557ed tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:42.389455 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-db0ec7fd-1536-4bac-9910-7692fbd557ed tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:42.390141 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-db0ec7fd-1536-4bac-9910-7692fbd557ed tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:42.390587 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-db0ec7fd-1536-4bac-9910-7692fbd557ed tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:42.391004 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-db0ec7fd-1536-4bac-9910-7692fbd557ed tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:42.518250 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-db0ec7fd-1536-4bac-9910-7692fbd557ed tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:42.526517 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-db0ec7fd-1536-4bac-9910-7692fbd557ed tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:42.527933 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-db0ec7fd-1536-4bac-9910-7692fbd557ed tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:42.529079 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-db0ec7fd-1536-4bac-9910-7692fbd557ed tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1721 microversion: 2.20 time: 0.153930 Aug 31 19:22:42.529721 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 476/947] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:22:42 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:22:43.552389 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-03e08210-9a8b-484c-a4a9-ecad86a7d638 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:43.553284 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-03e08210-9a8b-484c-a4a9-ecad86a7d638 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:43.559416 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-03e08210-9a8b-484c-a4a9-ecad86a7d638 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:43.559899 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-03e08210-9a8b-484c-a4a9-ecad86a7d638 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:43.560335 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-03e08210-9a8b-484c-a4a9-ecad86a7d638 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:43.561024 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-03e08210-9a8b-484c-a4a9-ecad86a7d638 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:43.561513 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-03e08210-9a8b-484c-a4a9-ecad86a7d638 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:43.561935 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-03e08210-9a8b-484c-a4a9-ecad86a7d638 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:43.836275 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-03e08210-9a8b-484c-a4a9-ecad86a7d638 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:43.845295 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-03e08210-9a8b-484c-a4a9-ecad86a7d638 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:43.847002 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-03e08210-9a8b-484c-a4a9-ecad86a7d638 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:43.848134 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-03e08210-9a8b-484c-a4a9-ecad86a7d638 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1721 microversion: 2.20 time: 0.299622 Aug 31 19:22:43.848678 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 472/948] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:22:43 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1721 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:22:44.869614 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-b6407f09-005f-4b56-b6a4-b63c30325ed3 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:44.870231 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-b6407f09-005f-4b56-b6a4-b63c30325ed3 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:44.877368 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b6407f09-005f-4b56-b6a4-b63c30325ed3 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:44.877853 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b6407f09-005f-4b56-b6a4-b63c30325ed3 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:44.878287 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b6407f09-005f-4b56-b6a4-b63c30325ed3 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:44.878974 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b6407f09-005f-4b56-b6a4-b63c30325ed3 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:44.879425 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b6407f09-005f-4b56-b6a4-b63c30325ed3 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:44.879852 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b6407f09-005f-4b56-b6a4-b63c30325ed3 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:45.010041 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-b6407f09-005f-4b56-b6a4-b63c30325ed3 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:45.018029 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-b6407f09-005f-4b56-b6a4-b63c30325ed3 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:45.019468 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-b6407f09-005f-4b56-b6a4-b63c30325ed3 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:45.020626 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-b6407f09-005f-4b56-b6a4-b63c30325ed3 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1721 microversion: 2.20 time: 0.154971 Aug 31 19:22:45.021182 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 477/949] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:22:44 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:22:46.043841 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e15ad061-81d4-4059-9bf9-3bbab3e3dfdd tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:46.044427 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-e15ad061-81d4-4059-9bf9-3bbab3e3dfdd tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:46.050844 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e15ad061-81d4-4059-9bf9-3bbab3e3dfdd tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:46.051326 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e15ad061-81d4-4059-9bf9-3bbab3e3dfdd tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:46.051846 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e15ad061-81d4-4059-9bf9-3bbab3e3dfdd tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:46.052531 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e15ad061-81d4-4059-9bf9-3bbab3e3dfdd tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:46.052979 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e15ad061-81d4-4059-9bf9-3bbab3e3dfdd tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:46.053424 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e15ad061-81d4-4059-9bf9-3bbab3e3dfdd tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:46.183737 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e15ad061-81d4-4059-9bf9-3bbab3e3dfdd tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:46.192805 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e15ad061-81d4-4059-9bf9-3bbab3e3dfdd tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:46.194278 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e15ad061-81d4-4059-9bf9-3bbab3e3dfdd tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:46.195434 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-e15ad061-81d4-4059-9bf9-3bbab3e3dfdd tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1721 microversion: 2.20 time: 0.156043 Aug 31 19:22:46.196258 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 473/950] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:22:46 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:22:47.218231 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-43bbda08-8f6a-440e-8ed6-7b50ba8bb6a9 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:47.218886 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-43bbda08-8f6a-440e-8ed6-7b50ba8bb6a9 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:47.225307 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-43bbda08-8f6a-440e-8ed6-7b50ba8bb6a9 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:47.225788 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-43bbda08-8f6a-440e-8ed6-7b50ba8bb6a9 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:47.226222 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-43bbda08-8f6a-440e-8ed6-7b50ba8bb6a9 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:47.226908 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-43bbda08-8f6a-440e-8ed6-7b50ba8bb6a9 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:47.227367 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-43bbda08-8f6a-440e-8ed6-7b50ba8bb6a9 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:47.227789 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-43bbda08-8f6a-440e-8ed6-7b50ba8bb6a9 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:47.354383 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-43bbda08-8f6a-440e-8ed6-7b50ba8bb6a9 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:47.362947 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-43bbda08-8f6a-440e-8ed6-7b50ba8bb6a9 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:47.364388 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-43bbda08-8f6a-440e-8ed6-7b50ba8bb6a9 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:47.365576 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-43bbda08-8f6a-440e-8ed6-7b50ba8bb6a9 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1721 microversion: 2.20 time: 0.151771 Aug 31 19:22:47.366138 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 478/951] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:22:47 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:22:48.388429 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-8d703c1d-2b22-41f4-895a-a8dfc653ccb4 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:48.389030 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-8d703c1d-2b22-41f4-895a-a8dfc653ccb4 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:48.395671 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8d703c1d-2b22-41f4-895a-a8dfc653ccb4 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:48.396151 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8d703c1d-2b22-41f4-895a-a8dfc653ccb4 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:48.396580 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8d703c1d-2b22-41f4-895a-a8dfc653ccb4 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:48.397296 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8d703c1d-2b22-41f4-895a-a8dfc653ccb4 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:48.397748 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8d703c1d-2b22-41f4-895a-a8dfc653ccb4 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:48.398163 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8d703c1d-2b22-41f4-895a-a8dfc653ccb4 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:48.524618 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-8d703c1d-2b22-41f4-895a-a8dfc653ccb4 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:48.533443 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-8d703c1d-2b22-41f4-895a-a8dfc653ccb4 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:48.534876 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-8d703c1d-2b22-41f4-895a-a8dfc653ccb4 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:48.536020 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-8d703c1d-2b22-41f4-895a-a8dfc653ccb4 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1721 microversion: 2.20 time: 0.151994 Aug 31 19:22:48.536587 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 474/952] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:22:48 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:22:49.558304 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-766cbe6b-f29a-4cab-9fba-e4e31a384ef8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:49.558922 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-766cbe6b-f29a-4cab-9fba-e4e31a384ef8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:49.565423 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-766cbe6b-f29a-4cab-9fba-e4e31a384ef8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:49.565907 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-766cbe6b-f29a-4cab-9fba-e4e31a384ef8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:49.566342 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-766cbe6b-f29a-4cab-9fba-e4e31a384ef8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:49.567029 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-766cbe6b-f29a-4cab-9fba-e4e31a384ef8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:49.567482 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-766cbe6b-f29a-4cab-9fba-e4e31a384ef8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:49.567905 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-766cbe6b-f29a-4cab-9fba-e4e31a384ef8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:49.698241 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-766cbe6b-f29a-4cab-9fba-e4e31a384ef8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:49.706247 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-766cbe6b-f29a-4cab-9fba-e4e31a384ef8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:49.707683 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-766cbe6b-f29a-4cab-9fba-e4e31a384ef8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:49.708838 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-766cbe6b-f29a-4cab-9fba-e4e31a384ef8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1721 microversion: 2.20 time: 0.154496 Aug 31 19:22:49.709436 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 479/953] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:22:49 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:22:50.732460 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e7592ea5-9e1a-48bc-bb6a-137a31cb23c5 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:50.733067 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-e7592ea5-9e1a-48bc-bb6a-137a31cb23c5 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:50.739548 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e7592ea5-9e1a-48bc-bb6a-137a31cb23c5 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:50.740030 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e7592ea5-9e1a-48bc-bb6a-137a31cb23c5 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:50.740462 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e7592ea5-9e1a-48bc-bb6a-137a31cb23c5 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:50.741146 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e7592ea5-9e1a-48bc-bb6a-137a31cb23c5 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:50.741625 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e7592ea5-9e1a-48bc-bb6a-137a31cb23c5 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:50.742182 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e7592ea5-9e1a-48bc-bb6a-137a31cb23c5 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:50.872027 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e7592ea5-9e1a-48bc-bb6a-137a31cb23c5 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:50.880000 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e7592ea5-9e1a-48bc-bb6a-137a31cb23c5 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:50.881468 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e7592ea5-9e1a-48bc-bb6a-137a31cb23c5 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:50.882641 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-e7592ea5-9e1a-48bc-bb6a-137a31cb23c5 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1721 microversion: 2.20 time: 0.154641 Aug 31 19:22:50.883195 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 475/954] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:22:50 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:22:51.905858 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-fcd04e3b-e8ab-4359-a8ab-10783b569888 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:51.906470 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-fcd04e3b-e8ab-4359-a8ab-10783b569888 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:51.913115 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fcd04e3b-e8ab-4359-a8ab-10783b569888 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:51.913628 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fcd04e3b-e8ab-4359-a8ab-10783b569888 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:51.914063 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fcd04e3b-e8ab-4359-a8ab-10783b569888 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:51.914746 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fcd04e3b-e8ab-4359-a8ab-10783b569888 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:51.915195 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fcd04e3b-e8ab-4359-a8ab-10783b569888 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:51.915613 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fcd04e3b-e8ab-4359-a8ab-10783b569888 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:52.044527 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-fcd04e3b-e8ab-4359-a8ab-10783b569888 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:52.052453 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-fcd04e3b-e8ab-4359-a8ab-10783b569888 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:52.053927 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-fcd04e3b-e8ab-4359-a8ab-10783b569888 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:52.055081 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-fcd04e3b-e8ab-4359-a8ab-10783b569888 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1721 microversion: 2.20 time: 0.153167 Aug 31 19:22:52.055638 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 480/955] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:22:51 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:22:53.078226 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-1111167f-e470-4f07-be48-043ec16d9df2 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:53.078830 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-1111167f-e470-4f07-be48-043ec16d9df2 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:53.084828 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1111167f-e470-4f07-be48-043ec16d9df2 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:53.085342 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1111167f-e470-4f07-be48-043ec16d9df2 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:53.085822 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1111167f-e470-4f07-be48-043ec16d9df2 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:53.086497 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1111167f-e470-4f07-be48-043ec16d9df2 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:53.086942 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1111167f-e470-4f07-be48-043ec16d9df2 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:53.087358 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1111167f-e470-4f07-be48-043ec16d9df2 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:53.214499 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1111167f-e470-4f07-be48-043ec16d9df2 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:53.222870 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1111167f-e470-4f07-be48-043ec16d9df2 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:53.224364 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1111167f-e470-4f07-be48-043ec16d9df2 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:53.225674 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-1111167f-e470-4f07-be48-043ec16d9df2 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1742 microversion: 2.20 time: 0.151935 Aug 31 19:22:53.226215 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 476/956] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:22:53 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1742 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:22:54.248294 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-970e2f8f-87fe-47e8-9870-44d92a8bcbc7 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:54.248895 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-970e2f8f-87fe-47e8-9870-44d92a8bcbc7 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:54.255276 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-970e2f8f-87fe-47e8-9870-44d92a8bcbc7 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:54.255748 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-970e2f8f-87fe-47e8-9870-44d92a8bcbc7 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:54.256174 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-970e2f8f-87fe-47e8-9870-44d92a8bcbc7 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:54.256847 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-970e2f8f-87fe-47e8-9870-44d92a8bcbc7 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:54.257319 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-970e2f8f-87fe-47e8-9870-44d92a8bcbc7 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:54.257735 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-970e2f8f-87fe-47e8-9870-44d92a8bcbc7 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:54.387676 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-970e2f8f-87fe-47e8-9870-44d92a8bcbc7 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:54.396012 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-970e2f8f-87fe-47e8-9870-44d92a8bcbc7 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:54.397470 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-970e2f8f-87fe-47e8-9870-44d92a8bcbc7 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:54.398601 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-970e2f8f-87fe-47e8-9870-44d92a8bcbc7 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1742 microversion: 2.20 time: 0.154445 Aug 31 19:22:54.399151 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 481/957] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:22:54 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1742 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:22:55.421521 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-ea0209c2-af8f-441e-96bf-2ada60bd35f7 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:55.422129 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-ea0209c2-af8f-441e-96bf-2ada60bd35f7 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:55.428519 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ea0209c2-af8f-441e-96bf-2ada60bd35f7 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:55.429006 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ea0209c2-af8f-441e-96bf-2ada60bd35f7 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:55.429469 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ea0209c2-af8f-441e-96bf-2ada60bd35f7 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:55.430159 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ea0209c2-af8f-441e-96bf-2ada60bd35f7 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:55.430613 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ea0209c2-af8f-441e-96bf-2ada60bd35f7 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:55.431034 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ea0209c2-af8f-441e-96bf-2ada60bd35f7 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:55.561674 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-ea0209c2-af8f-441e-96bf-2ada60bd35f7 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:55.569817 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-ea0209c2-af8f-441e-96bf-2ada60bd35f7 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:55.571231 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-ea0209c2-af8f-441e-96bf-2ada60bd35f7 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:55.572367 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-ea0209c2-af8f-441e-96bf-2ada60bd35f7 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1742 microversion: 2.20 time: 0.154985 Aug 31 19:22:55.572914 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 477/958] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:22:55 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1742 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:22:56.594993 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-ea8848bc-47db-4ba8-b84c-d8d53c1a0ccc tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:56.595598 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-ea8848bc-47db-4ba8-b84c-d8d53c1a0ccc tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:56.602298 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ea8848bc-47db-4ba8-b84c-d8d53c1a0ccc tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:56.602781 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ea8848bc-47db-4ba8-b84c-d8d53c1a0ccc tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:56.603209 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ea8848bc-47db-4ba8-b84c-d8d53c1a0ccc tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:56.603896 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ea8848bc-47db-4ba8-b84c-d8d53c1a0ccc tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:56.604345 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ea8848bc-47db-4ba8-b84c-d8d53c1a0ccc tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:56.604761 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ea8848bc-47db-4ba8-b84c-d8d53c1a0ccc tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:56.732783 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-ea8848bc-47db-4ba8-b84c-d8d53c1a0ccc tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:56.740808 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-ea8848bc-47db-4ba8-b84c-d8d53c1a0ccc tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:56.742256 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-ea8848bc-47db-4ba8-b84c-d8d53c1a0ccc tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:56.743401 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-ea8848bc-47db-4ba8-b84c-d8d53c1a0ccc tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1742 microversion: 2.20 time: 0.152366 Aug 31 19:22:56.743945 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 482/959] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:22:56 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1742 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:22:57.388394 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-b904b81e-f306-4634-88c2-08f1c216ab69 req-713ded36-18dc-48e3-8816-3c4c18b3ff99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ff90966-a8dd-41ae-848d-e155bf217b05", "name": "network-vif-plugged", "status": "completed", "tag": "54483789-2137-488f-8b8d-250e234b5c3c"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:22:57.398364 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-b904b81e-f306-4634-88c2-08f1c216ab69 req-713ded36-18dc-48e3-8816-3c4c18b3ff99 service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:57.398835 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-b904b81e-f306-4634-88c2-08f1c216ab69 req-713ded36-18dc-48e3-8816-3c4c18b3ff99 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:57.399263 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-b904b81e-f306-4634-88c2-08f1c216ab69 req-713ded36-18dc-48e3-8816-3c4c18b3ff99 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:57.412060 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-b904b81e-f306-4634-88c2-08f1c216ab69 req-713ded36-18dc-48e3-8816-3c4c18b3ff99 service nova] Creating event network-vif-plugged:54483789-2137-488f-8b8d-250e234b5c3c for instance 5ff90966-a8dd-41ae-848d-e155bf217b05 on hv-cinder-83538 Aug 31 19:22:57.416978 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-b904b81e-f306-4634-88c2-08f1c216ab69 req-713ded36-18dc-48e3-8816-3c4c18b3ff99 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032207 Aug 31 19:22:57.417590 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 478/960] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:22:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:22:57.765817 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-595f7f45-db9b-4493-81e1-edf50dbf83ca tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:57.766430 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-595f7f45-db9b-4493-81e1-edf50dbf83ca tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:57.772799 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-595f7f45-db9b-4493-81e1-edf50dbf83ca tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:57.773313 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-595f7f45-db9b-4493-81e1-edf50dbf83ca tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:57.773743 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-595f7f45-db9b-4493-81e1-edf50dbf83ca tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:57.774424 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-595f7f45-db9b-4493-81e1-edf50dbf83ca tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:57.774878 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-595f7f45-db9b-4493-81e1-edf50dbf83ca tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:57.775297 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-595f7f45-db9b-4493-81e1-edf50dbf83ca tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:57.901091 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-595f7f45-db9b-4493-81e1-edf50dbf83ca tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:57.909469 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-595f7f45-db9b-4493-81e1-edf50dbf83ca tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:57.910883 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-595f7f45-db9b-4493-81e1-edf50dbf83ca tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:57.912016 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-595f7f45-db9b-4493-81e1-edf50dbf83ca tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1742 microversion: 2.20 time: 0.150153 Aug 31 19:22:57.912561 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 483/961] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:22:57 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1742 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:22:58.936131 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-be75ca1f-e41d-4161-9d0c-bda710593dd1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:58.936812 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-be75ca1f-e41d-4161-9d0c-bda710593dd1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:58.942939 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-be75ca1f-e41d-4161-9d0c-bda710593dd1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:58.943414 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-be75ca1f-e41d-4161-9d0c-bda710593dd1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:58.943838 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-be75ca1f-e41d-4161-9d0c-bda710593dd1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:58.944507 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-be75ca1f-e41d-4161-9d0c-bda710593dd1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:58.944949 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-be75ca1f-e41d-4161-9d0c-bda710593dd1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:58.945392 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-be75ca1f-e41d-4161-9d0c-bda710593dd1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:59.076983 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-be75ca1f-e41d-4161-9d0c-bda710593dd1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:59.085106 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-be75ca1f-e41d-4161-9d0c-bda710593dd1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:59.086641 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-be75ca1f-e41d-4161-9d0c-bda710593dd1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:59.087835 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-be75ca1f-e41d-4161-9d0c-bda710593dd1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1742 microversion: 2.20 time: 0.156381 Aug 31 19:22:59.088314 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 479/962] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:22:58 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1742 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:23:00.112381 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-95aee023-a2c2-40a0-b3b9-3da1a7e03e3c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:00.113706 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-95aee023-a2c2-40a0-b3b9-3da1a7e03e3c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:00.120350 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-95aee023-a2c2-40a0-b3b9-3da1a7e03e3c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:00.121041 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-95aee023-a2c2-40a0-b3b9-3da1a7e03e3c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:00.121651 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-95aee023-a2c2-40a0-b3b9-3da1a7e03e3c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:00.122474 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-95aee023-a2c2-40a0-b3b9-3da1a7e03e3c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:00.123001 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-95aee023-a2c2-40a0-b3b9-3da1a7e03e3c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:00.123490 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-95aee023-a2c2-40a0-b3b9-3da1a7e03e3c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:00.279303 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-95aee023-a2c2-40a0-b3b9-3da1a7e03e3c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:00.286863 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-95aee023-a2c2-40a0-b3b9-3da1a7e03e3c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:00.288573 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-95aee023-a2c2-40a0-b3b9-3da1a7e03e3c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:00.290722 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-95aee023-a2c2-40a0-b3b9-3da1a7e03e3c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1737 microversion: 2.20 time: 0.183175 Aug 31 19:23:00.291485 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 484/963] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:23:00 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1737 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:23:01.317234 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-c023c113-7b98-4f91-8635-f33d81bfd3fa tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:01.318648 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-c023c113-7b98-4f91-8635-f33d81bfd3fa tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:01.330634 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c023c113-7b98-4f91-8635-f33d81bfd3fa tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:01.331426 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c023c113-7b98-4f91-8635-f33d81bfd3fa tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:01.331870 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c023c113-7b98-4f91-8635-f33d81bfd3fa tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:01.332575 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c023c113-7b98-4f91-8635-f33d81bfd3fa tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:01.333034 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c023c113-7b98-4f91-8635-f33d81bfd3fa tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:01.333538 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c023c113-7b98-4f91-8635-f33d81bfd3fa tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:01.474826 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-c023c113-7b98-4f91-8635-f33d81bfd3fa tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:01.485580 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-c023c113-7b98-4f91-8635-f33d81bfd3fa tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:01.487339 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-c023c113-7b98-4f91-8635-f33d81bfd3fa tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:01.489478 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-c023c113-7b98-4f91-8635-f33d81bfd3fa tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1737 microversion: 2.20 time: 0.178364 Aug 31 19:23:01.490591 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 480/964] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:23:01 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1737 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:23:02.513008 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-399f6e0c-e691-4062-a55e-e8185627c480 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:02.513642 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-399f6e0c-e691-4062-a55e-e8185627c480 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:02.521386 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-399f6e0c-e691-4062-a55e-e8185627c480 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:02.522113 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-399f6e0c-e691-4062-a55e-e8185627c480 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:02.522547 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-399f6e0c-e691-4062-a55e-e8185627c480 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:02.523437 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-399f6e0c-e691-4062-a55e-e8185627c480 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:02.524117 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-399f6e0c-e691-4062-a55e-e8185627c480 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:02.524741 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-399f6e0c-e691-4062-a55e-e8185627c480 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:02.661410 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-399f6e0c-e691-4062-a55e-e8185627c480 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:02.674046 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-399f6e0c-e691-4062-a55e-e8185627c480 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:02.675688 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-399f6e0c-e691-4062-a55e-e8185627c480 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:02.677045 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-399f6e0c-e691-4062-a55e-e8185627c480 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1737 microversion: 2.20 time: 0.168573 Aug 31 19:23:02.677706 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 485/965] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:23:02 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1737 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:23:03.703350 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-94a702cd-b181-465a-86f7-9472aa41debd tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:03.703977 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-94a702cd-b181-465a-86f7-9472aa41debd tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:03.711444 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-94a702cd-b181-465a-86f7-9472aa41debd tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:03.711934 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-94a702cd-b181-465a-86f7-9472aa41debd tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:03.712384 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-94a702cd-b181-465a-86f7-9472aa41debd tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:03.713064 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-94a702cd-b181-465a-86f7-9472aa41debd tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:03.713553 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-94a702cd-b181-465a-86f7-9472aa41debd tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:03.713981 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-94a702cd-b181-465a-86f7-9472aa41debd tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:04.120436 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-94a702cd-b181-465a-86f7-9472aa41debd tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:04.131692 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-94a702cd-b181-465a-86f7-9472aa41debd tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:04.142477 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-94a702cd-b181-465a-86f7-9472aa41debd tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:04.143817 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-94a702cd-b181-465a-86f7-9472aa41debd tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1737 microversion: 2.20 time: 0.444416 Aug 31 19:23:04.144479 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 481/966] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:23:03 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1737 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:23:05.165812 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-88aa10db-6355-4abf-ba56-eab721e6f4d5 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:05.166345 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-88aa10db-6355-4abf-ba56-eab721e6f4d5 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:05.173049 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-88aa10db-6355-4abf-ba56-eab721e6f4d5 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:05.173753 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-88aa10db-6355-4abf-ba56-eab721e6f4d5 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:05.174435 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-88aa10db-6355-4abf-ba56-eab721e6f4d5 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:05.175365 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-88aa10db-6355-4abf-ba56-eab721e6f4d5 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:05.176066 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-88aa10db-6355-4abf-ba56-eab721e6f4d5 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:05.176736 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-88aa10db-6355-4abf-ba56-eab721e6f4d5 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:05.347606 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-88aa10db-6355-4abf-ba56-eab721e6f4d5 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:05.357771 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-88aa10db-6355-4abf-ba56-eab721e6f4d5 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:05.359208 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-88aa10db-6355-4abf-ba56-eab721e6f4d5 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:05.360389 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-88aa10db-6355-4abf-ba56-eab721e6f4d5 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1737 microversion: 2.20 time: 0.198560 Aug 31 19:23:05.373434 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 486/967] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:23:05 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1737 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:23:06.386988 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-290e9510-c4fd-4e69-996d-8c1e748e6679 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:06.388343 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-290e9510-c4fd-4e69-996d-8c1e748e6679 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:06.395959 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-290e9510-c4fd-4e69-996d-8c1e748e6679 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:06.397592 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-290e9510-c4fd-4e69-996d-8c1e748e6679 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:06.398028 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-290e9510-c4fd-4e69-996d-8c1e748e6679 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:06.398738 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-290e9510-c4fd-4e69-996d-8c1e748e6679 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:06.399207 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-290e9510-c4fd-4e69-996d-8c1e748e6679 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:06.399643 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-290e9510-c4fd-4e69-996d-8c1e748e6679 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:06.532685 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-290e9510-c4fd-4e69-996d-8c1e748e6679 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:06.540789 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-290e9510-c4fd-4e69-996d-8c1e748e6679 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:06.542244 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-290e9510-c4fd-4e69-996d-8c1e748e6679 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:06.543407 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-290e9510-c4fd-4e69-996d-8c1e748e6679 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1737 microversion: 2.20 time: 0.161512 Aug 31 19:23:06.543973 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 482/968] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:23:06 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:23:07.566622 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-59802e09-6879-4f75-994b-3df1eacbbf14 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:07.567304 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-59802e09-6879-4f75-994b-3df1eacbbf14 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:07.575902 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-59802e09-6879-4f75-994b-3df1eacbbf14 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:07.575902 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-59802e09-6879-4f75-994b-3df1eacbbf14 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:07.576435 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-59802e09-6879-4f75-994b-3df1eacbbf14 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:07.577248 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-59802e09-6879-4f75-994b-3df1eacbbf14 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:07.577813 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-59802e09-6879-4f75-994b-3df1eacbbf14 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:07.578301 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-59802e09-6879-4f75-994b-3df1eacbbf14 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:07.727935 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-59802e09-6879-4f75-994b-3df1eacbbf14 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:07.737338 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-59802e09-6879-4f75-994b-3df1eacbbf14 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:07.738764 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-59802e09-6879-4f75-994b-3df1eacbbf14 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:07.739927 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-59802e09-6879-4f75-994b-3df1eacbbf14 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1737 microversion: 2.20 time: 0.177956 Aug 31 19:23:07.740485 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 487/969] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:23:07 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1737 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:23:08.761592 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-6836fcc5-336d-4ad5-b54d-af6cf7c0a965 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:08.762200 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-6836fcc5-336d-4ad5-b54d-af6cf7c0a965 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:08.769087 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6836fcc5-336d-4ad5-b54d-af6cf7c0a965 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:08.769628 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6836fcc5-336d-4ad5-b54d-af6cf7c0a965 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:08.770062 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6836fcc5-336d-4ad5-b54d-af6cf7c0a965 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:08.770741 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6836fcc5-336d-4ad5-b54d-af6cf7c0a965 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:08.771193 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6836fcc5-336d-4ad5-b54d-af6cf7c0a965 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:08.771611 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6836fcc5-336d-4ad5-b54d-af6cf7c0a965 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:08.900770 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-6836fcc5-336d-4ad5-b54d-af6cf7c0a965 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:08.909487 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-6836fcc5-336d-4ad5-b54d-af6cf7c0a965 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:08.910917 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-6836fcc5-336d-4ad5-b54d-af6cf7c0a965 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:08.912069 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-6836fcc5-336d-4ad5-b54d-af6cf7c0a965 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1737 microversion: 2.20 time: 0.154371 Aug 31 19:23:08.912616 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 483/970] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:23:08 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:23:09.933681 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-fa091472-c630-46e0-b00a-9469c3bfff20 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:09.934289 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-fa091472-c630-46e0-b00a-9469c3bfff20 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:09.940874 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fa091472-c630-46e0-b00a-9469c3bfff20 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:09.941413 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fa091472-c630-46e0-b00a-9469c3bfff20 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:09.941852 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fa091472-c630-46e0-b00a-9469c3bfff20 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:09.942578 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fa091472-c630-46e0-b00a-9469c3bfff20 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:09.943028 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fa091472-c630-46e0-b00a-9469c3bfff20 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:09.943448 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fa091472-c630-46e0-b00a-9469c3bfff20 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:10.159829 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-fa091472-c630-46e0-b00a-9469c3bfff20 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:10.167828 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-fa091472-c630-46e0-b00a-9469c3bfff20 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:10.169278 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-fa091472-c630-46e0-b00a-9469c3bfff20 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:10.170488 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-fa091472-c630-46e0-b00a-9469c3bfff20 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1719 microversion: 2.20 time: 0.240751 Aug 31 19:23:10.171037 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 488/971] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:23:09 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1719 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:23:11.193575 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-a2e7c0cd-daa0-4dfc-a596-4932793b41b6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:11.194125 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-a2e7c0cd-daa0-4dfc-a596-4932793b41b6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:11.196484 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=29 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:11.202132 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a2e7c0cd-daa0-4dfc-a596-4932793b41b6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:11.202611 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a2e7c0cd-daa0-4dfc-a596-4932793b41b6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:11.203039 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a2e7c0cd-daa0-4dfc-a596-4932793b41b6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:11.203719 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a2e7c0cd-daa0-4dfc-a596-4932793b41b6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:11.204165 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a2e7c0cd-daa0-4dfc-a596-4932793b41b6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:11.204578 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a2e7c0cd-daa0-4dfc-a596-4932793b41b6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:11.207314 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=79 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:11.338833 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-a2e7c0cd-daa0-4dfc-a596-4932793b41b6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:11.347587 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-a2e7c0cd-daa0-4dfc-a596-4932793b41b6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:11.349014 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-a2e7c0cd-daa0-4dfc-a596-4932793b41b6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:11.350178 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-a2e7c0cd-daa0-4dfc-a596-4932793b41b6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1719 microversion: 2.20 time: 0.160710 Aug 31 19:23:11.350721 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 484/972] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:23:11 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1719 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:23:12.373105 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-8248b381-d1d8-461d-95a8-129667eb7a3c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:12.373722 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-8248b381-d1d8-461d-95a8-129667eb7a3c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:12.375992 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_api:SELECT=29 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:12.381275 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8248b381-d1d8-461d-95a8-129667eb7a3c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:12.381759 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8248b381-d1d8-461d-95a8-129667eb7a3c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:12.382200 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8248b381-d1d8-461d-95a8-129667eb7a3c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:12.382894 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8248b381-d1d8-461d-95a8-129667eb7a3c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:12.383322 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8248b381-d1d8-461d-95a8-129667eb7a3c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:12.383778 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8248b381-d1d8-461d-95a8-129667eb7a3c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:12.386558 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:12.516015 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-8248b381-d1d8-461d-95a8-129667eb7a3c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:12.524619 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-8248b381-d1d8-461d-95a8-129667eb7a3c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:12.526191 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-8248b381-d1d8-461d-95a8-129667eb7a3c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:12.527357 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-8248b381-d1d8-461d-95a8-129667eb7a3c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1722 microversion: 2.20 time: 0.158348 Aug 31 19:23:12.527903 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 489/973] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:23:12 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:23:12.549553 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-2c4c5845-d604-4ac0-b19a-6812bb5987c5 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4aee0b9f-7092-4e21-8103-c428599086c8"}} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:23:12.551865 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-2c4c5845-d604-4ac0-b19a-6812bb5987c5 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:12.558335 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2c4c5845-d604-4ac0-b19a-6812bb5987c5 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:12.558835 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2c4c5845-d604-4ac0-b19a-6812bb5987c5 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:12.559272 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2c4c5845-d604-4ac0-b19a-6812bb5987c5 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:12.560001 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2c4c5845-d604-4ac0-b19a-6812bb5987c5 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:12.560456 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2c4c5845-d604-4ac0-b19a-6812bb5987c5 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:12.560885 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2c4c5845-d604-4ac0-b19a-6812bb5987c5 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:12.837341 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-2c4c5845-d604-4ac0-b19a-6812bb5987c5 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "POST /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.291825 Aug 31 19:23:12.837937 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 485/974] 10.222.0.65 () {62 vars in 1364 bytes} [Wed Aug 31 19:23:12 2022] POST /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05/os-volume_attachments => generated 188 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 19:23:12.963040 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-29d39d7a-53b6-4da0-8ced-e9971b921eea tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:23:12.963779 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-29d39d7a-53b6-4da0-8ced-e9971b921eea tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:12.971305 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-29d39d7a-53b6-4da0-8ced-e9971b921eea tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:12.971797 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-29d39d7a-53b6-4da0-8ced-e9971b921eea tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:12.972229 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-29d39d7a-53b6-4da0-8ced-e9971b921eea tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:12.973160 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-29d39d7a-53b6-4da0-8ced-e9971b921eea tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:12.973413 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-29d39d7a-53b6-4da0-8ced-e9971b921eea tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:12.973838 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-29d39d7a-53b6-4da0-8ced-e9971b921eea tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:13.075120 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-29d39d7a-53b6-4da0-8ced-e9971b921eea tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120624) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 19:23:13.149693 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-29d39d7a-53b6-4da0-8ced-e9971b921eea tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "POST /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05/action" status: 202 len: 0 microversion: 2.20 time: 0.191990 Aug 31 19:23:13.150287 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 490/975] 10.222.0.65 () {62 vars in 1319 bytes} [Wed Aug 31 19:23:12 2022] POST /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:23:13.159556 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-3c6a051a-6f2b-4479-8813-3b52ffde5374 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:13.160294 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-3c6a051a-6f2b-4479-8813-3b52ffde5374 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:13.167421 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3c6a051a-6f2b-4479-8813-3b52ffde5374 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:13.167974 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3c6a051a-6f2b-4479-8813-3b52ffde5374 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:13.168410 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3c6a051a-6f2b-4479-8813-3b52ffde5374 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:13.169815 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3c6a051a-6f2b-4479-8813-3b52ffde5374 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:13.170268 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3c6a051a-6f2b-4479-8813-3b52ffde5374 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:13.170689 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3c6a051a-6f2b-4479-8813-3b52ffde5374 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:13.308598 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-3c6a051a-6f2b-4479-8813-3b52ffde5374 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:13.318599 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-3c6a051a-6f2b-4479-8813-3b52ffde5374 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:13.320052 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-3c6a051a-6f2b-4479-8813-3b52ffde5374 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:13.321248 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-3c6a051a-6f2b-4479-8813-3b52ffde5374 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1748 microversion: 2.20 time: 0.166745 Aug 31 19:23:13.321999 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 486/976] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:23:13 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1748 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:23:13.418141 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-2c0ce031-5582-48f3-aa8c-79dbe2186584 req-65bafad3-4c6c-4c94-8078-5da7b41e698d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ff90966-a8dd-41ae-848d-e155bf217b05", "name": "network-vif-unplugged", "status": "completed", "tag": "54483789-2137-488f-8b8d-250e234b5c3c"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:23:13.428581 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-2c0ce031-5582-48f3-aa8c-79dbe2186584 req-65bafad3-4c6c-4c94-8078-5da7b41e698d service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:13.429060 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-2c0ce031-5582-48f3-aa8c-79dbe2186584 req-65bafad3-4c6c-4c94-8078-5da7b41e698d service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:13.429518 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-2c0ce031-5582-48f3-aa8c-79dbe2186584 req-65bafad3-4c6c-4c94-8078-5da7b41e698d service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:13.441585 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.compute.server_external_events [req-2c0ce031-5582-48f3-aa8c-79dbe2186584 req-65bafad3-4c6c-4c94-8078-5da7b41e698d service nova] Unable to find a host for instance 5ff90966-a8dd-41ae-848d-e155bf217b05. Dropping event network-vif-unplugged {{(pid=120624) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 31 19:23:13.442473 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-2c0ce031-5582-48f3-aa8c-79dbe2186584 req-65bafad3-4c6c-4c94-8078-5da7b41e698d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028657 Aug 31 19:23:13.443058 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 491/977] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:23:13 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 31 19:23:14.344555 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-ba8de19c-bc5a-48b6-ac01-65f22acfd7af tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:14.345101 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-ba8de19c-bc5a-48b6-ac01-65f22acfd7af tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:14.351818 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ba8de19c-bc5a-48b6-ac01-65f22acfd7af tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:14.352299 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ba8de19c-bc5a-48b6-ac01-65f22acfd7af tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:14.352730 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ba8de19c-bc5a-48b6-ac01-65f22acfd7af tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:14.353445 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ba8de19c-bc5a-48b6-ac01-65f22acfd7af tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:14.353901 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ba8de19c-bc5a-48b6-ac01-65f22acfd7af tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:14.354323 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ba8de19c-bc5a-48b6-ac01-65f22acfd7af tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:14.481158 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-ba8de19c-bc5a-48b6-ac01-65f22acfd7af tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:14.490355 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-ba8de19c-bc5a-48b6-ac01-65f22acfd7af tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:14.491771 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-ba8de19c-bc5a-48b6-ac01-65f22acfd7af tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:14.492906 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-ba8de19c-bc5a-48b6-ac01-65f22acfd7af tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1750 microversion: 2.20 time: 0.152992 Aug 31 19:23:14.493498 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 487/978] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:23:14 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1750 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:23:15.515815 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-b4cd4db1-7bf9-4a89-809f-83cebde0e3a0 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:15.516422 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-b4cd4db1-7bf9-4a89-809f-83cebde0e3a0 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:15.522845 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b4cd4db1-7bf9-4a89-809f-83cebde0e3a0 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:15.523326 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b4cd4db1-7bf9-4a89-809f-83cebde0e3a0 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:15.523807 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b4cd4db1-7bf9-4a89-809f-83cebde0e3a0 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:15.524500 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b4cd4db1-7bf9-4a89-809f-83cebde0e3a0 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:15.524953 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b4cd4db1-7bf9-4a89-809f-83cebde0e3a0 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:15.525408 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b4cd4db1-7bf9-4a89-809f-83cebde0e3a0 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:15.723939 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-b4cd4db1-7bf9-4a89-809f-83cebde0e3a0 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:15.733223 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-b4cd4db1-7bf9-4a89-809f-83cebde0e3a0 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:15.734653 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-b4cd4db1-7bf9-4a89-809f-83cebde0e3a0 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:15.735830 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-b4cd4db1-7bf9-4a89-809f-83cebde0e3a0 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1806 microversion: 2.20 time: 0.224024 Aug 31 19:23:15.736387 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 492/979] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:23:15 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1806 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:23:16.758193 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-789af73f-f23e-4277-8d22-bbb23ad42a15 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:16.759513 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-789af73f-f23e-4277-8d22-bbb23ad42a15 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:16.766787 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-789af73f-f23e-4277-8d22-bbb23ad42a15 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:16.767284 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-789af73f-f23e-4277-8d22-bbb23ad42a15 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:16.767724 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-789af73f-f23e-4277-8d22-bbb23ad42a15 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:16.768423 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-789af73f-f23e-4277-8d22-bbb23ad42a15 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:16.768876 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-789af73f-f23e-4277-8d22-bbb23ad42a15 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:16.769326 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-789af73f-f23e-4277-8d22-bbb23ad42a15 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:16.913925 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-789af73f-f23e-4277-8d22-bbb23ad42a15 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:16.923719 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-789af73f-f23e-4277-8d22-bbb23ad42a15 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:16.926133 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-789af73f-f23e-4277-8d22-bbb23ad42a15 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:16.927676 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-789af73f-f23e-4277-8d22-bbb23ad42a15 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1806 microversion: 2.20 time: 0.173256 Aug 31 19:23:16.932460 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 488/980] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:23:16 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1806 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:23:17.951228 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-398fe36e-0813-4fd5-8c96-ad4079275357 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:17.951899 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-398fe36e-0813-4fd5-8c96-ad4079275357 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:17.957895 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-398fe36e-0813-4fd5-8c96-ad4079275357 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:17.958483 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-398fe36e-0813-4fd5-8c96-ad4079275357 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:17.958804 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-398fe36e-0813-4fd5-8c96-ad4079275357 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:17.959487 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-398fe36e-0813-4fd5-8c96-ad4079275357 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:17.960013 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-398fe36e-0813-4fd5-8c96-ad4079275357 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:17.960353 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-398fe36e-0813-4fd5-8c96-ad4079275357 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:18.098504 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-398fe36e-0813-4fd5-8c96-ad4079275357 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:18.107298 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-398fe36e-0813-4fd5-8c96-ad4079275357 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:18.108729 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-398fe36e-0813-4fd5-8c96-ad4079275357 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:18.109939 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-398fe36e-0813-4fd5-8c96-ad4079275357 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1806 microversion: 2.20 time: 0.163544 Aug 31 19:23:18.110503 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 493/981] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:23:17 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1806 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:23:19.135864 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-7a3d34e1-f5b7-4484-b661-4c823e7efe9a tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:19.136446 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-7a3d34e1-f5b7-4484-b661-4c823e7efe9a tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:19.142845 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7a3d34e1-f5b7-4484-b661-4c823e7efe9a tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:19.143330 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7a3d34e1-f5b7-4484-b661-4c823e7efe9a tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:19.143763 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7a3d34e1-f5b7-4484-b661-4c823e7efe9a tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:19.144450 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7a3d34e1-f5b7-4484-b661-4c823e7efe9a tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:19.144906 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7a3d34e1-f5b7-4484-b661-4c823e7efe9a tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:19.145359 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7a3d34e1-f5b7-4484-b661-4c823e7efe9a tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:19.290130 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-7a3d34e1-f5b7-4484-b661-4c823e7efe9a tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:19.300213 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-7a3d34e1-f5b7-4484-b661-4c823e7efe9a tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:19.301717 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-7a3d34e1-f5b7-4484-b661-4c823e7efe9a tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:19.302995 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-7a3d34e1-f5b7-4484-b661-4c823e7efe9a tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1806 microversion: 2.20 time: 0.171170 Aug 31 19:23:19.303750 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 489/982] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:23:19 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1806 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:23:20.330226 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-9d139f64-0002-4eac-a069-39a44951ee6d tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:20.331871 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-9d139f64-0002-4eac-a069-39a44951ee6d tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:20.339781 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9d139f64-0002-4eac-a069-39a44951ee6d tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:20.340417 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9d139f64-0002-4eac-a069-39a44951ee6d tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:20.340917 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9d139f64-0002-4eac-a069-39a44951ee6d tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:20.341739 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9d139f64-0002-4eac-a069-39a44951ee6d tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:20.342260 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9d139f64-0002-4eac-a069-39a44951ee6d tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:20.342683 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9d139f64-0002-4eac-a069-39a44951ee6d tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:20.476231 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-9d139f64-0002-4eac-a069-39a44951ee6d tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:20.485384 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-9d139f64-0002-4eac-a069-39a44951ee6d tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:20.486823 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-9d139f64-0002-4eac-a069-39a44951ee6d tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:20.488004 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-9d139f64-0002-4eac-a069-39a44951ee6d tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1806 microversion: 2.20 time: 0.164220 Aug 31 19:23:20.488566 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 494/983] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:23:20 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1806 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:23:21.510684 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-63f67796-6374-48c0-82a4-18bbe9f6163b tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:21.511431 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-63f67796-6374-48c0-82a4-18bbe9f6163b tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:21.518258 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-63f67796-6374-48c0-82a4-18bbe9f6163b tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:21.518744 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-63f67796-6374-48c0-82a4-18bbe9f6163b tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:21.519176 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-63f67796-6374-48c0-82a4-18bbe9f6163b tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:21.519899 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-63f67796-6374-48c0-82a4-18bbe9f6163b tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:21.520625 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-63f67796-6374-48c0-82a4-18bbe9f6163b tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:21.521292 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-63f67796-6374-48c0-82a4-18bbe9f6163b tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:21.670890 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-63f67796-6374-48c0-82a4-18bbe9f6163b tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:21.679536 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-63f67796-6374-48c0-82a4-18bbe9f6163b tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:21.681011 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-63f67796-6374-48c0-82a4-18bbe9f6163b tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:21.682214 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-63f67796-6374-48c0-82a4-18bbe9f6163b tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1806 microversion: 2.20 time: 0.175735 Aug 31 19:23:21.682769 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 490/984] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:23:21 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1806 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:23:22.319515 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-dc522098-3838-43ca-b226-97b6051af3d8 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:22.320159 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-dc522098-3838-43ca-b226-97b6051af3d8 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: db83c2c0-f1c0-40e5-9d61-11a89b10bab6] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:22.326761 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dc522098-3838-43ca-b226-97b6051af3d8 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:22.327303 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dc522098-3838-43ca-b226-97b6051af3d8 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:22.327729 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dc522098-3838-43ca-b226-97b6051af3d8 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:22.328413 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dc522098-3838-43ca-b226-97b6051af3d8 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:22.328866 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dc522098-3838-43ca-b226-97b6051af3d8 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:22.329330 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dc522098-3838-43ca-b226-97b6051af3d8 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:22.356434 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-dc522098-3838-43ca-b226-97b6051af3d8 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/db83c2c0-f1c0-40e5-9d61-11a89b10bab6/ips" status: 200 len: 150 microversion: 2.1 time: 0.189189 Aug 31 19:23:22.362938 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 495/985] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Aug 31 19:23:22 2022] GET /compute/v2.1/servers/db83c2c0-f1c0-40e5-9d61-11a89b10bab6/ips => generated 150 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:23:22.704528 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-23771557-fea0-48eb-92bf-0e29fd1a9681 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:22.705114 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-23771557-fea0-48eb-92bf-0e29fd1a9681 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:22.711538 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-23771557-fea0-48eb-92bf-0e29fd1a9681 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:22.712026 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-23771557-fea0-48eb-92bf-0e29fd1a9681 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:22.712527 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-23771557-fea0-48eb-92bf-0e29fd1a9681 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:22.713284 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-23771557-fea0-48eb-92bf-0e29fd1a9681 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:22.713741 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-23771557-fea0-48eb-92bf-0e29fd1a9681 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:22.714165 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-23771557-fea0-48eb-92bf-0e29fd1a9681 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:22.864014 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-23771557-fea0-48eb-92bf-0e29fd1a9681 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:22.873527 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-23771557-fea0-48eb-92bf-0e29fd1a9681 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:22.875013 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-23771557-fea0-48eb-92bf-0e29fd1a9681 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:22.876247 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-23771557-fea0-48eb-92bf-0e29fd1a9681 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1806 microversion: 2.20 time: 0.175905 Aug 31 19:23:22.876845 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 491/986] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:23:22 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1806 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:23:23.760725 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-7e19530d-580f-41ae-8a99-9f9dd56732c0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e03db9b4-d521-451b-8626-131ff098eb13"}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:23:23.763362 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-7e19530d-580f-41ae-8a99-9f9dd56732c0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: db83c2c0-f1c0-40e5-9d61-11a89b10bab6] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:23.770061 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7e19530d-580f-41ae-8a99-9f9dd56732c0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:23.770549 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7e19530d-580f-41ae-8a99-9f9dd56732c0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:23.770983 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7e19530d-580f-41ae-8a99-9f9dd56732c0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:23.771701 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7e19530d-580f-41ae-8a99-9f9dd56732c0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:23.772155 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7e19530d-580f-41ae-8a99-9f9dd56732c0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:23.772572 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7e19530d-580f-41ae-8a99-9f9dd56732c0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:23.899409 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-8e5bdd52-82c7-4b2b-9df8-a008e7bc84c1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:23.899993 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-8e5bdd52-82c7-4b2b-9df8-a008e7bc84c1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:23.907034 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8e5bdd52-82c7-4b2b-9df8-a008e7bc84c1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:23.907514 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8e5bdd52-82c7-4b2b-9df8-a008e7bc84c1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:23.907941 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8e5bdd52-82c7-4b2b-9df8-a008e7bc84c1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:23.908635 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8e5bdd52-82c7-4b2b-9df8-a008e7bc84c1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:23.909084 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8e5bdd52-82c7-4b2b-9df8-a008e7bc84c1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:23.909526 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8e5bdd52-82c7-4b2b-9df8-a008e7bc84c1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:24.054638 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-8e5bdd52-82c7-4b2b-9df8-a008e7bc84c1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:24.065786 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-8e5bdd52-82c7-4b2b-9df8-a008e7bc84c1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:24.067358 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-8e5bdd52-82c7-4b2b-9df8-a008e7bc84c1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:24.068537 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-8e5bdd52-82c7-4b2b-9df8-a008e7bc84c1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1806 microversion: 2.20 time: 0.173064 Aug 31 19:23:24.069120 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 492/987] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:23:23 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1806 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:23:25.096260 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-1296dd5a-1510-479e-8219-9d0c5e59205f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:25.097283 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-1296dd5a-1510-479e-8219-9d0c5e59205f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:25.107729 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1296dd5a-1510-479e-8219-9d0c5e59205f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:25.108527 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1296dd5a-1510-479e-8219-9d0c5e59205f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:25.109285 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1296dd5a-1510-479e-8219-9d0c5e59205f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:25.110457 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1296dd5a-1510-479e-8219-9d0c5e59205f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:25.111205 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1296dd5a-1510-479e-8219-9d0c5e59205f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:25.111926 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1296dd5a-1510-479e-8219-9d0c5e59205f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:25.256445 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1296dd5a-1510-479e-8219-9d0c5e59205f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:25.265603 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1296dd5a-1510-479e-8219-9d0c5e59205f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:25.267036 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1296dd5a-1510-479e-8219-9d0c5e59205f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:25.268193 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-1296dd5a-1510-479e-8219-9d0c5e59205f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1806 microversion: 2.20 time: 0.180088 Aug 31 19:23:25.268739 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 493/988] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:23:25 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1806 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:23:26.291215 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-84b40246-ab71-4309-821a-814204667f6e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:26.292107 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-84b40246-ab71-4309-821a-814204667f6e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:26.299139 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-84b40246-ab71-4309-821a-814204667f6e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:26.299629 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-84b40246-ab71-4309-821a-814204667f6e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:26.300069 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-84b40246-ab71-4309-821a-814204667f6e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:26.300761 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-84b40246-ab71-4309-821a-814204667f6e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:26.301237 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-84b40246-ab71-4309-821a-814204667f6e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:26.301665 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-84b40246-ab71-4309-821a-814204667f6e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:26.430809 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-84b40246-ab71-4309-821a-814204667f6e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:26.439515 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-84b40246-ab71-4309-821a-814204667f6e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:26.440960 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-84b40246-ab71-4309-821a-814204667f6e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:26.442178 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-84b40246-ab71-4309-821a-814204667f6e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1806 microversion: 2.20 time: 0.154873 Aug 31 19:23:26.442728 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 494/989] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:23:26 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1806 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:23:27.464712 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-c47fff0e-9541-45bc-ae83-5d4ee0042027 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:27.465375 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-c47fff0e-9541-45bc-ae83-5d4ee0042027 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:27.471866 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c47fff0e-9541-45bc-ae83-5d4ee0042027 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:27.472348 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c47fff0e-9541-45bc-ae83-5d4ee0042027 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:27.472778 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c47fff0e-9541-45bc-ae83-5d4ee0042027 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:27.473494 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c47fff0e-9541-45bc-ae83-5d4ee0042027 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:27.473943 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c47fff0e-9541-45bc-ae83-5d4ee0042027 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:27.474363 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c47fff0e-9541-45bc-ae83-5d4ee0042027 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:27.605028 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-c47fff0e-9541-45bc-ae83-5d4ee0042027 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:27.614170 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-c47fff0e-9541-45bc-ae83-5d4ee0042027 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:27.615611 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-c47fff0e-9541-45bc-ae83-5d4ee0042027 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:27.616764 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-c47fff0e-9541-45bc-ae83-5d4ee0042027 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1806 microversion: 2.20 time: 0.156100 Aug 31 19:23:27.617351 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 495/990] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:23:27 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:23:28.640905 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e677169e-d4c5-41b0-ab1b-73efcafdf4e3 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:28.641608 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-e677169e-d4c5-41b0-ab1b-73efcafdf4e3 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:28.647979 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e677169e-d4c5-41b0-ab1b-73efcafdf4e3 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:28.648463 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e677169e-d4c5-41b0-ab1b-73efcafdf4e3 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:28.648903 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e677169e-d4c5-41b0-ab1b-73efcafdf4e3 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:28.649655 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e677169e-d4c5-41b0-ab1b-73efcafdf4e3 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:28.650110 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e677169e-d4c5-41b0-ab1b-73efcafdf4e3 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:28.650533 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e677169e-d4c5-41b0-ab1b-73efcafdf4e3 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:28.777070 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e677169e-d4c5-41b0-ab1b-73efcafdf4e3 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:28.785654 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e677169e-d4c5-41b0-ab1b-73efcafdf4e3 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:28.787100 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e677169e-d4c5-41b0-ab1b-73efcafdf4e3 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:28.788255 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-e677169e-d4c5-41b0-ab1b-73efcafdf4e3 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1806 microversion: 2.20 time: 0.151979 Aug 31 19:23:28.788806 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 496/991] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:23:28 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1806 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:23:29.811141 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-9f4f12e6-1405-4684-9749-e3451fd590b8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:29.811818 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-9f4f12e6-1405-4684-9749-e3451fd590b8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:29.818539 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9f4f12e6-1405-4684-9749-e3451fd590b8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:29.819031 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9f4f12e6-1405-4684-9749-e3451fd590b8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:29.819470 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9f4f12e6-1405-4684-9749-e3451fd590b8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:29.820204 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9f4f12e6-1405-4684-9749-e3451fd590b8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:29.820699 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9f4f12e6-1405-4684-9749-e3451fd590b8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:29.821128 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9f4f12e6-1405-4684-9749-e3451fd590b8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:29.950663 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-9f4f12e6-1405-4684-9749-e3451fd590b8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:29.960009 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-9f4f12e6-1405-4684-9749-e3451fd590b8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:29.961481 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-9f4f12e6-1405-4684-9749-e3451fd590b8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:29.962644 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-9f4f12e6-1405-4684-9749-e3451fd590b8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1806 microversion: 2.20 time: 0.155427 Aug 31 19:23:29.963229 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 497/992] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:23:29 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:23:30.216834 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-7e19530d-580f-41ae-8a99-9f9dd56732c0 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "POST /compute/v2.1/servers/db83c2c0-f1c0-40e5-9d61-11a89b10bab6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.459907 Aug 31 19:23:30.218047 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 496/993] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 31 19:23:23 2022] POST /compute/v2.1/servers/db83c2c0-f1c0-40e5-9d61-11a89b10bab6/os-volume_attachments => generated 194 bytes in 6462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:23:30.985969 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-0a44fd6a-a81e-415e-abc6-69b3af013e31 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:30.986509 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-0a44fd6a-a81e-415e-abc6-69b3af013e31 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:30.992843 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0a44fd6a-a81e-415e-abc6-69b3af013e31 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:30.993360 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0a44fd6a-a81e-415e-abc6-69b3af013e31 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:30.993798 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0a44fd6a-a81e-415e-abc6-69b3af013e31 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:30.994485 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0a44fd6a-a81e-415e-abc6-69b3af013e31 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:30.994940 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0a44fd6a-a81e-415e-abc6-69b3af013e31 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:30.995366 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0a44fd6a-a81e-415e-abc6-69b3af013e31 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:30.999874 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:31.127298 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-0a44fd6a-a81e-415e-abc6-69b3af013e31 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:31.137050 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-0a44fd6a-a81e-415e-abc6-69b3af013e31 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:31.138515 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-0a44fd6a-a81e-415e-abc6-69b3af013e31 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:31.140011 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-0a44fd6a-a81e-415e-abc6-69b3af013e31 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1806 microversion: 2.20 time: 0.158343 Aug 31 19:23:31.140574 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 498/994] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:23:30 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1806 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:23:32.163658 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-0f1bd71d-e55e-4ff4-9dfe-3a2999b7c2ce tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:32.164344 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-0f1bd71d-e55e-4ff4-9dfe-3a2999b7c2ce tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:32.171628 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0f1bd71d-e55e-4ff4-9dfe-3a2999b7c2ce tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:32.172096 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0f1bd71d-e55e-4ff4-9dfe-3a2999b7c2ce tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:32.172544 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0f1bd71d-e55e-4ff4-9dfe-3a2999b7c2ce tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:32.173236 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0f1bd71d-e55e-4ff4-9dfe-3a2999b7c2ce tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:32.173683 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0f1bd71d-e55e-4ff4-9dfe-3a2999b7c2ce tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:32.174097 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0f1bd71d-e55e-4ff4-9dfe-3a2999b7c2ce tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:32.304973 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-0f1bd71d-e55e-4ff4-9dfe-3a2999b7c2ce tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:32.313659 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-0f1bd71d-e55e-4ff4-9dfe-3a2999b7c2ce tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:32.315106 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-0f1bd71d-e55e-4ff4-9dfe-3a2999b7c2ce tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:32.316265 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-0f1bd71d-e55e-4ff4-9dfe-3a2999b7c2ce tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1806 microversion: 2.20 time: 0.157385 Aug 31 19:23:32.316817 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 497/995] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:23:32 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:23:33.338789 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-0a028571-bd1c-439c-b0dd-61228b4b9e89 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:33.339495 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-0a028571-bd1c-439c-b0dd-61228b4b9e89 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:33.347056 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0a028571-bd1c-439c-b0dd-61228b4b9e89 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:33.347535 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0a028571-bd1c-439c-b0dd-61228b4b9e89 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:33.347967 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0a028571-bd1c-439c-b0dd-61228b4b9e89 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:33.348657 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0a028571-bd1c-439c-b0dd-61228b4b9e89 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:33.349110 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0a028571-bd1c-439c-b0dd-61228b4b9e89 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:33.349587 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0a028571-bd1c-439c-b0dd-61228b4b9e89 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:33.476781 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-0a028571-bd1c-439c-b0dd-61228b4b9e89 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:33.485306 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-0a028571-bd1c-439c-b0dd-61228b4b9e89 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:33.486729 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-0a028571-bd1c-439c-b0dd-61228b4b9e89 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:33.487872 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-0a028571-bd1c-439c-b0dd-61228b4b9e89 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1806 microversion: 2.20 time: 0.153044 Aug 31 19:23:33.488417 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 499/996] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:23:33 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1806 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:23:34.510182 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-d639ccbf-8758-4efc-ab72-14224467b2d4 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:34.510794 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-d639ccbf-8758-4efc-ab72-14224467b2d4 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:34.517371 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d639ccbf-8758-4efc-ab72-14224467b2d4 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:34.517851 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d639ccbf-8758-4efc-ab72-14224467b2d4 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:34.518279 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d639ccbf-8758-4efc-ab72-14224467b2d4 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:34.518968 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d639ccbf-8758-4efc-ab72-14224467b2d4 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:34.519421 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d639ccbf-8758-4efc-ab72-14224467b2d4 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:34.519841 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d639ccbf-8758-4efc-ab72-14224467b2d4 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:34.646918 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-d639ccbf-8758-4efc-ab72-14224467b2d4 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:34.656018 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-d639ccbf-8758-4efc-ab72-14224467b2d4 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:34.657507 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-d639ccbf-8758-4efc-ab72-14224467b2d4 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:34.658701 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-d639ccbf-8758-4efc-ab72-14224467b2d4 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1806 microversion: 2.20 time: 0.152412 Aug 31 19:23:34.659258 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 498/997] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:23:34 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1806 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:23:35.682225 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-87d450bf-869d-4191-867c-d54d7304132e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:35.682833 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-87d450bf-869d-4191-867c-d54d7304132e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:35.690192 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-87d450bf-869d-4191-867c-d54d7304132e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:35.690672 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-87d450bf-869d-4191-867c-d54d7304132e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:35.691107 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-87d450bf-869d-4191-867c-d54d7304132e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:35.691798 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-87d450bf-869d-4191-867c-d54d7304132e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:35.692272 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-87d450bf-869d-4191-867c-d54d7304132e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:35.692684 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-87d450bf-869d-4191-867c-d54d7304132e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:35.821379 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-87d450bf-869d-4191-867c-d54d7304132e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:35.830005 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-87d450bf-869d-4191-867c-d54d7304132e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:35.831446 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-87d450bf-869d-4191-867c-d54d7304132e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:35.832605 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-87d450bf-869d-4191-867c-d54d7304132e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1806 microversion: 2.20 time: 0.154273 Aug 31 19:23:35.833155 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 500/998] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:23:35 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1806 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:23:36.855769 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-b8fb0392-7a1e-4b29-b50d-19195705f7a1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:36.856364 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-b8fb0392-7a1e-4b29-b50d-19195705f7a1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:36.863356 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b8fb0392-7a1e-4b29-b50d-19195705f7a1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:36.863823 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b8fb0392-7a1e-4b29-b50d-19195705f7a1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:36.864262 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b8fb0392-7a1e-4b29-b50d-19195705f7a1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:36.864911 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b8fb0392-7a1e-4b29-b50d-19195705f7a1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:36.865449 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b8fb0392-7a1e-4b29-b50d-19195705f7a1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:36.865861 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b8fb0392-7a1e-4b29-b50d-19195705f7a1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:37.238308 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-b8fb0392-7a1e-4b29-b50d-19195705f7a1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:37.246839 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-b8fb0392-7a1e-4b29-b50d-19195705f7a1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:37.248270 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-b8fb0392-7a1e-4b29-b50d-19195705f7a1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:37.249447 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-b8fb0392-7a1e-4b29-b50d-19195705f7a1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1806 microversion: 2.20 time: 0.397601 Aug 31 19:23:37.249998 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 499/999] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:23:36 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1806 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:23:37.831206 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-bdd4c73f-8a96-431b-bcda-d0cb3b0f2ba1 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:37.832122 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-bdd4c73f-8a96-431b-bcda-d0cb3b0f2ba1 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: db83c2c0-f1c0-40e5-9d61-11a89b10bab6] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:37.838505 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bdd4c73f-8a96-431b-bcda-d0cb3b0f2ba1 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:37.838988 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bdd4c73f-8a96-431b-bcda-d0cb3b0f2ba1 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:37.839420 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bdd4c73f-8a96-431b-bcda-d0cb3b0f2ba1 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:37.840108 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bdd4c73f-8a96-431b-bcda-d0cb3b0f2ba1 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:37.840653 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bdd4c73f-8a96-431b-bcda-d0cb3b0f2ba1 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:37.841152 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bdd4c73f-8a96-431b-bcda-d0cb3b0f2ba1 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:37.920945 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.objects.instance [None req-bdd4c73f-8a96-431b-bcda-d0cb3b0f2ba1 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lazy-loading 'services' on Instance uuid db83c2c0-f1c0-40e5-9d61-11a89b10bab6 {{(pid=120623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:23:37.991167 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-bdd4c73f-8a96-431b-bcda-d0cb3b0f2ba1 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "DELETE /compute/v2.1/servers/db83c2c0-f1c0-40e5-9d61-11a89b10bab6/os-volume_attachments/e03db9b4-d521-451b-8626-131ff098eb13" status: 202 len: 0 microversion: 2.1 time: 0.163680 Aug 31 19:23:37.991778 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 501/1000] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Aug 31 19:23:37 2022] DELETE /compute/v2.1/servers/db83c2c0-f1c0-40e5-9d61-11a89b10bab6/os-volume_attachments/e03db9b4-d521-451b-8626-131ff098eb13 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:23:38.000665 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-925a56a8-a5e6-460a-bc87-ca6f02a95255 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:38.002971 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-925a56a8-a5e6-460a-bc87-ca6f02a95255 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: db83c2c0-f1c0-40e5-9d61-11a89b10bab6] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:38.009789 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-925a56a8-a5e6-460a-bc87-ca6f02a95255 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:38.010272 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-925a56a8-a5e6-460a-bc87-ca6f02a95255 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:38.010701 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-925a56a8-a5e6-460a-bc87-ca6f02a95255 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:38.011637 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-925a56a8-a5e6-460a-bc87-ca6f02a95255 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:38.012090 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-925a56a8-a5e6-460a-bc87-ca6f02a95255 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:38.012510 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-925a56a8-a5e6-460a-bc87-ca6f02a95255 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:38.041951 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-925a56a8-a5e6-460a-bc87-ca6f02a95255 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/db83c2c0-f1c0-40e5-9d61-11a89b10bab6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045770 Aug 31 19:23:38.042508 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 500/1001] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 31 19:23:37 2022] GET /compute/v2.1/servers/db83c2c0-f1c0-40e5-9d61-11a89b10bab6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:23:38.272447 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-21036c30-008f-4b0d-bc46-a0a6849eddab tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:38.273145 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-21036c30-008f-4b0d-bc46-a0a6849eddab tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:38.279427 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-21036c30-008f-4b0d-bc46-a0a6849eddab tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:38.279912 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-21036c30-008f-4b0d-bc46-a0a6849eddab tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:38.280347 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-21036c30-008f-4b0d-bc46-a0a6849eddab tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:38.281070 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-21036c30-008f-4b0d-bc46-a0a6849eddab tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:38.282094 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-21036c30-008f-4b0d-bc46-a0a6849eddab tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:38.282519 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-21036c30-008f-4b0d-bc46-a0a6849eddab tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:38.417859 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-21036c30-008f-4b0d-bc46-a0a6849eddab tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:38.426996 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-21036c30-008f-4b0d-bc46-a0a6849eddab tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:38.428414 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-21036c30-008f-4b0d-bc46-a0a6849eddab tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:38.429588 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-21036c30-008f-4b0d-bc46-a0a6849eddab tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1806 microversion: 2.20 time: 0.161384 Aug 31 19:23:38.430129 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 502/1002] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:23:38 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1806 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:23:39.053873 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-d906f2cf-9117-4e17-9533-a5e692d48319 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:39.056101 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-d906f2cf-9117-4e17-9533-a5e692d48319 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: db83c2c0-f1c0-40e5-9d61-11a89b10bab6] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:39.063059 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d906f2cf-9117-4e17-9533-a5e692d48319 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:39.063532 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d906f2cf-9117-4e17-9533-a5e692d48319 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:39.063960 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d906f2cf-9117-4e17-9533-a5e692d48319 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:39.064638 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d906f2cf-9117-4e17-9533-a5e692d48319 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:39.065085 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d906f2cf-9117-4e17-9533-a5e692d48319 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:39.065527 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d906f2cf-9117-4e17-9533-a5e692d48319 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:39.094333 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-d906f2cf-9117-4e17-9533-a5e692d48319 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/db83c2c0-f1c0-40e5-9d61-11a89b10bab6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044357 Aug 31 19:23:39.094805 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 501/1003] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 31 19:23:39 2022] GET /compute/v2.1/servers/db83c2c0-f1c0-40e5-9d61-11a89b10bab6/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 19:23:39.156873 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-0ffb2ae2-235a-4c5f-84a8-ec59d71cf46f tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:39.157441 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-0ffb2ae2-235a-4c5f-84a8-ec59d71cf46f tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: db83c2c0-f1c0-40e5-9d61-11a89b10bab6] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:39.163795 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0ffb2ae2-235a-4c5f-84a8-ec59d71cf46f tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:39.164282 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0ffb2ae2-235a-4c5f-84a8-ec59d71cf46f tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:39.164719 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0ffb2ae2-235a-4c5f-84a8-ec59d71cf46f tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:39.165438 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0ffb2ae2-235a-4c5f-84a8-ec59d71cf46f tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:39.165898 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0ffb2ae2-235a-4c5f-84a8-ec59d71cf46f tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:39.166322 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0ffb2ae2-235a-4c5f-84a8-ec59d71cf46f tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:39.193082 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-0ffb2ae2-235a-4c5f-84a8-ec59d71cf46f tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: db83c2c0-f1c0-40e5-9d61-11a89b10bab6] Going to try to terminate instance {{(pid=120623) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 19:23:39.268402 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-0ffb2ae2-235a-4c5f-84a8-ec59d71cf46f tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "DELETE /compute/v2.1/servers/db83c2c0-f1c0-40e5-9d61-11a89b10bab6" status: 204 len: 0 microversion: 2.1 time: 0.115078 Aug 31 19:23:39.269251 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 503/1004] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 31 19:23:39 2022] DELETE /compute/v2.1/servers/db83c2c0-f1c0-40e5-9d61-11a89b10bab6 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:23:39.277443 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-29d4a2fe-8a50-4234-bba2-49ec7f9a1ff2 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:39.278236 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-29d4a2fe-8a50-4234-bba2-49ec7f9a1ff2 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: db83c2c0-f1c0-40e5-9d61-11a89b10bab6] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:39.284106 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-29d4a2fe-8a50-4234-bba2-49ec7f9a1ff2 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:39.284580 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-29d4a2fe-8a50-4234-bba2-49ec7f9a1ff2 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:39.285012 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-29d4a2fe-8a50-4234-bba2-49ec7f9a1ff2 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:39.285725 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-29d4a2fe-8a50-4234-bba2-49ec7f9a1ff2 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:39.286173 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-29d4a2fe-8a50-4234-bba2-49ec7f9a1ff2 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:39.286586 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-29d4a2fe-8a50-4234-bba2-49ec7f9a1ff2 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:39.409989 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-29d4a2fe-8a50-4234-bba2-49ec7f9a1ff2 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:39.417673 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-29d4a2fe-8a50-4234-bba2-49ec7f9a1ff2 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/db83c2c0-f1c0-40e5-9d61-11a89b10bab6" status: 200 len: 1682 microversion: 2.1 time: 0.144191 Aug 31 19:23:39.418471 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 502/1005] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:39 2022] GET /compute/v2.1/servers/db83c2c0-f1c0-40e5-9d61-11a89b10bab6 => generated 1682 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:23:39.452392 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-ffce0777-fe02-4083-9890-a488ff18b979 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:39.453145 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-ffce0777-fe02-4083-9890-a488ff18b979 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:39.458961 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ffce0777-fe02-4083-9890-a488ff18b979 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:39.459442 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ffce0777-fe02-4083-9890-a488ff18b979 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:39.459874 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ffce0777-fe02-4083-9890-a488ff18b979 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:39.460558 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ffce0777-fe02-4083-9890-a488ff18b979 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:39.461013 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ffce0777-fe02-4083-9890-a488ff18b979 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:39.461459 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ffce0777-fe02-4083-9890-a488ff18b979 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:39.590879 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-ffce0777-fe02-4083-9890-a488ff18b979 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:39.600236 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-ffce0777-fe02-4083-9890-a488ff18b979 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:39.601902 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-ffce0777-fe02-4083-9890-a488ff18b979 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:39.603301 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-ffce0777-fe02-4083-9890-a488ff18b979 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1806 microversion: 2.20 time: 0.155128 Aug 31 19:23:39.603883 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 504/1006] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:23:39 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:23:40.439458 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-1574cc41-5aea-4947-8c53-77f44d7e5259 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:40.440045 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-1574cc41-5aea-4947-8c53-77f44d7e5259 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: db83c2c0-f1c0-40e5-9d61-11a89b10bab6] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:40.446804 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1574cc41-5aea-4947-8c53-77f44d7e5259 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:40.447230 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1574cc41-5aea-4947-8c53-77f44d7e5259 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:40.447660 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1574cc41-5aea-4947-8c53-77f44d7e5259 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:40.448351 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1574cc41-5aea-4947-8c53-77f44d7e5259 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:40.448803 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1574cc41-5aea-4947-8c53-77f44d7e5259 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:40.449239 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1574cc41-5aea-4947-8c53-77f44d7e5259 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:40.580430 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-1574cc41-5aea-4947-8c53-77f44d7e5259 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:40.588220 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-1574cc41-5aea-4947-8c53-77f44d7e5259 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/db83c2c0-f1c0-40e5-9d61-11a89b10bab6" status: 200 len: 1682 microversion: 2.1 time: 0.153138 Aug 31 19:23:40.588784 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 503/1007] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:40 2022] GET /compute/v2.1/servers/db83c2c0-f1c0-40e5-9d61-11a89b10bab6 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:40.627134 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-c0f3be82-98c7-40dc-877b-bb7f6fe46ef2 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:40.627748 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-c0f3be82-98c7-40dc-877b-bb7f6fe46ef2 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:40.634140 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c0f3be82-98c7-40dc-877b-bb7f6fe46ef2 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:40.634585 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c0f3be82-98c7-40dc-877b-bb7f6fe46ef2 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:40.635018 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c0f3be82-98c7-40dc-877b-bb7f6fe46ef2 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:40.635705 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c0f3be82-98c7-40dc-877b-bb7f6fe46ef2 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:40.636160 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c0f3be82-98c7-40dc-877b-bb7f6fe46ef2 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:40.636586 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c0f3be82-98c7-40dc-877b-bb7f6fe46ef2 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:40.772694 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-c0f3be82-98c7-40dc-877b-bb7f6fe46ef2 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:40.781401 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-c0f3be82-98c7-40dc-877b-bb7f6fe46ef2 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:40.782839 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-c0f3be82-98c7-40dc-877b-bb7f6fe46ef2 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:40.783990 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-c0f3be82-98c7-40dc-877b-bb7f6fe46ef2 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1806 microversion: 2.20 time: 0.161299 Aug 31 19:23:40.784544 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 505/1008] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:23:40 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:23:41.609314 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-3258aec7-faec-4234-b251-09f69731d1f7 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:41.610063 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-3258aec7-faec-4234-b251-09f69731d1f7 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: db83c2c0-f1c0-40e5-9d61-11a89b10bab6] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:41.612123 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:41.620798 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3258aec7-faec-4234-b251-09f69731d1f7 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:41.621626 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3258aec7-faec-4234-b251-09f69731d1f7 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:41.622287 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3258aec7-faec-4234-b251-09f69731d1f7 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:41.623227 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3258aec7-faec-4234-b251-09f69731d1f7 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:41.623902 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3258aec7-faec-4234-b251-09f69731d1f7 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:41.624560 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3258aec7-faec-4234-b251-09f69731d1f7 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:41.670303 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-194d1872-e70f-4df2-93b9-2fa08f5c6593 req-7d77705f-2575-4b97-9ffe-194147c40e44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ff90966-a8dd-41ae-848d-e155bf217b05", "name": "network-vif-plugged", "status": "completed", "tag": "54483789-2137-488f-8b8d-250e234b5c3c"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:23:41.680847 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-194d1872-e70f-4df2-93b9-2fa08f5c6593 req-7d77705f-2575-4b97-9ffe-194147c40e44 service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:41.681448 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-194d1872-e70f-4df2-93b9-2fa08f5c6593 req-7d77705f-2575-4b97-9ffe-194147c40e44 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:41.681957 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-194d1872-e70f-4df2-93b9-2fa08f5c6593 req-7d77705f-2575-4b97-9ffe-194147c40e44 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:41.693450 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-194d1872-e70f-4df2-93b9-2fa08f5c6593 req-7d77705f-2575-4b97-9ffe-194147c40e44 service nova] Creating event network-vif-plugged:54483789-2137-488f-8b8d-250e234b5c3c for instance 5ff90966-a8dd-41ae-848d-e155bf217b05 on hv-cinder-83538 Aug 31 19:23:41.699447 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-194d1872-e70f-4df2-93b9-2fa08f5c6593 req-7d77705f-2575-4b97-9ffe-194147c40e44 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127028 Aug 31 19:23:41.700240 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 504/1009] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:23:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:23:41.763843 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-3258aec7-faec-4234-b251-09f69731d1f7 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:41.772462 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-3258aec7-faec-4234-b251-09f69731d1f7 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/db83c2c0-f1c0-40e5-9d61-11a89b10bab6" status: 200 len: 1682 microversion: 2.1 time: 0.166943 Aug 31 19:23:41.773095 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 506/1010] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:41 2022] GET /compute/v2.1/servers/db83c2c0-f1c0-40e5-9d61-11a89b10bab6 => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:23:41.806998 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-796fc86c-891f-41a8-9ab1-f7e05b3d193d tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:41.807684 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-796fc86c-891f-41a8-9ab1-f7e05b3d193d tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:41.814432 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-796fc86c-891f-41a8-9ab1-f7e05b3d193d tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:41.814901 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-796fc86c-891f-41a8-9ab1-f7e05b3d193d tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:41.815319 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-796fc86c-891f-41a8-9ab1-f7e05b3d193d tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:41.815989 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-796fc86c-891f-41a8-9ab1-f7e05b3d193d tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:41.816430 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-796fc86c-891f-41a8-9ab1-f7e05b3d193d tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:41.816841 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-796fc86c-891f-41a8-9ab1-f7e05b3d193d tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:41.819445 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:42.032013 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-796fc86c-891f-41a8-9ab1-f7e05b3d193d tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:42.041225 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-796fc86c-891f-41a8-9ab1-f7e05b3d193d tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:42.042660 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-796fc86c-891f-41a8-9ab1-f7e05b3d193d tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:42.043824 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-796fc86c-891f-41a8-9ab1-f7e05b3d193d tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1806 microversion: 2.20 time: 0.241099 Aug 31 19:23:42.044383 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 505/1011] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:23:41 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1806 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:23:42.228662 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-ce167015-d6f3-4961-9376-32dab46d7225 req-f1709d79-c992-4134-bf61-ea6f4c670bb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db83c2c0-f1c0-40e5-9d61-11a89b10bab6", "name": "network-vif-deleted", "tag": "202c471d-0cc7-4090-80ac-2d7ff7c4ea26"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:23:42.247307 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-ce167015-d6f3-4961-9376-32dab46d7225 req-f1709d79-c992-4134-bf61-ea6f4c670bb8 service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:42.253527 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-ce167015-d6f3-4961-9376-32dab46d7225 req-f1709d79-c992-4134-bf61-ea6f4c670bb8 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:42.254282 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-ce167015-d6f3-4961-9376-32dab46d7225 req-f1709d79-c992-4134-bf61-ea6f4c670bb8 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:42.269129 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-ce167015-d6f3-4961-9376-32dab46d7225 req-f1709d79-c992-4134-bf61-ea6f4c670bb8 service nova] Creating event network-vif-deleted:202c471d-0cc7-4090-80ac-2d7ff7c4ea26 for instance db83c2c0-f1c0-40e5-9d61-11a89b10bab6 on hv-cinder-83538 Aug 31 19:23:42.276014 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-ce167015-d6f3-4961-9376-32dab46d7225 req-f1709d79-c992-4134-bf61-ea6f4c670bb8 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136821 Aug 31 19:23:42.278039 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 507/1012] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:23:42.793767 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-58c9baa9-8cf8-4fef-9039-08c450ec9a61 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:42.794370 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-58c9baa9-8cf8-4fef-9039-08c450ec9a61 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: db83c2c0-f1c0-40e5-9d61-11a89b10bab6] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:42.796625 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:42.803160 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-58c9baa9-8cf8-4fef-9039-08c450ec9a61 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:42.803635 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-58c9baa9-8cf8-4fef-9039-08c450ec9a61 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:42.804062 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-58c9baa9-8cf8-4fef-9039-08c450ec9a61 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:42.804748 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-58c9baa9-8cf8-4fef-9039-08c450ec9a61 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:42.805206 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-58c9baa9-8cf8-4fef-9039-08c450ec9a61 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:42.805628 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-58c9baa9-8cf8-4fef-9039-08c450ec9a61 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:42.840464 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-58c9baa9-8cf8-4fef-9039-08c450ec9a61 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:42.841018 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-58c9baa9-8cf8-4fef-9039-08c450ec9a61 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:42.841538 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-58c9baa9-8cf8-4fef-9039-08c450ec9a61 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:42.841975 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.objects.instance [None req-58c9baa9-8cf8-4fef-9039-08c450ec9a61 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lazy-loading 'fault' on Instance uuid db83c2c0-f1c0-40e5-9d61-11a89b10bab6 {{(pid=120624) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:23:42.883009 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-58c9baa9-8cf8-4fef-9039-08c450ec9a61 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfa1533b0944bd681f4c2a33cf701b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d782400f1e432c8d10a31334c42e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:42.890707 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-58c9baa9-8cf8-4fef-9039-08c450ec9a61 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/db83c2c0-f1c0-40e5-9d61-11a89b10bab6" status: 200 len: 1332 microversion: 2.1 time: 0.100766 Aug 31 19:23:42.891341 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 506/1013] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:42 2022] GET /compute/v2.1/servers/db83c2c0-f1c0-40e5-9d61-11a89b10bab6 => generated 1332 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:43.068872 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-2093b304-5cdd-4804-bdda-754b7b726b73 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:43.069811 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-2093b304-5cdd-4804-bdda-754b7b726b73 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:43.076139 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2093b304-5cdd-4804-bdda-754b7b726b73 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:43.076586 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2093b304-5cdd-4804-bdda-754b7b726b73 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:43.077075 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2093b304-5cdd-4804-bdda-754b7b726b73 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:43.077722 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2093b304-5cdd-4804-bdda-754b7b726b73 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:43.078708 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2093b304-5cdd-4804-bdda-754b7b726b73 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:43.079128 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2093b304-5cdd-4804-bdda-754b7b726b73 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:43.219396 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-2093b304-5cdd-4804-bdda-754b7b726b73 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:43.228539 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-2093b304-5cdd-4804-bdda-754b7b726b73 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:43.229994 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-2093b304-5cdd-4804-bdda-754b7b726b73 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:43.231148 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-2093b304-5cdd-4804-bdda-754b7b726b73 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1806 microversion: 2.20 time: 0.167369 Aug 31 19:23:43.231706 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 508/1014] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:23:43 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1806 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:23:43.911461 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-51a006a5-dc36-4229-9258-ec563133d759 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:43.912108 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-51a006a5-dc36-4229-9258-ec563133d759 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: db83c2c0-f1c0-40e5-9d61-11a89b10bab6] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:43.918517 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-51a006a5-dc36-4229-9258-ec563133d759 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:43.918997 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-51a006a5-dc36-4229-9258-ec563133d759 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:43.919433 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-51a006a5-dc36-4229-9258-ec563133d759 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:43.920121 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-51a006a5-dc36-4229-9258-ec563133d759 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:43.920571 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-51a006a5-dc36-4229-9258-ec563133d759 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:43.920990 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-51a006a5-dc36-4229-9258-ec563133d759 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:43.934567 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.wsgi [None req-51a006a5-dc36-4229-9258-ec563133d759 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] HTTP exception thrown: Instance db83c2c0-f1c0-40e5-9d61-11a89b10bab6 could not be found. Aug 31 19:23:43.936177 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-51a006a5-dc36-4229-9258-ec563133d759 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Request method failure captured: Aug 31 19:23:43.936177 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: request: GET /compute/v2.1/servers/db83c2c0-f1c0-40e5-9d61-11a89b10bab6 HTTP/1.1 Aug 31 19:23:43.936177 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept: application/json Aug 31 19:23:43.936177 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Aug 31 19:23:43.936177 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Connection: close Aug 31 19:23:43.936177 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Length: 0 Aug 31 19:23:43.936177 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Type: application/json Aug 31 19:23:43.936177 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Host: 10.222.0.65 Aug 31 19:23:43.936177 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Aug 31 19:23:43.936177 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Aug 31 19:23:43.936177 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjD7KQFx_CTgljpc_qTbwt7yeZ02hQJcRRTGjLujiMjCCm-y4KZuXdAcd8yicyJshoDc3mgcG2dVFxaRyv0OYT2U8p5W3ZDfvXP2qQyvl9GhMqVycMoUFtordGBMOd64j9xBsCCsuy7lF-JjelfCeTLgdgY5owS10WSU3cjBe8ulEuuUA Aug 31 19:23:43.936177 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Aug 31 19:23:43.936177 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Aug 31 19:23:43.936177 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Aug 31 19:23:43.936177 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Aug 31 19:23:43.936177 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Aug 31 19:23:43.936177 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Aug 31 19:23:43.936177 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Id: e6d782400f1e432c8d10a31334c42e68 Aug 31 19:23:43.936177 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-AttachVolumeNegativeTest-739769459 Aug 31 19:23:43.936177 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Role: member,reader Aug 31 19:23:43.936177 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Roles: member,reader Aug 31 19:23:43.938551 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/e6d782400f1e432c8d10a31334c42e68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e6d782400f1e432c8d10a31334c42e68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_e6d782400f1e432c8d10a31334c42e68", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e6d782400f1e432c8d10a31334c42e68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:23:43.938551 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-AttachVolumeNegativeTest-739769459 Aug 31 19:23:43.938551 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Id: e6d782400f1e432c8d10a31334c42e68 Aug 31 19:23:43.938551 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-739769459 Aug 31 19:23:43.938551 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User: tempest-AttachVolumeNegativeTest-739769459-project Aug 31 19:23:43.938551 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Aug 31 19:23:43.938551 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Aug 31 19:23:43.938551 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Id: 0bfa1533b0944bd681f4c2a33cf701b0 Aug 31 19:23:43.938551 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-AttachVolumeNegativeTest-739769459-project Aug 31 19:23:43.938551 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: method: > Aug 31 19:23:43.938551 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: exception: Instance db83c2c0-f1c0-40e5-9d61-11a89b10bab6 could not be found. Aug 31 19:23:43.938551 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: action_args: {'id': 'db83c2c0-f1c0-40e5-9d61-11a89b10bab6'} Aug 31 19:23:43.939465 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:23:43.939465 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:23:43.939465 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:23:43.939465 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:23:43.939465 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:23:43.939465 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:23:43.939465 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:23:43.939465 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:23:43.939465 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:23:43.939465 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:23:43.939465 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db83c2c0-f1c0-40e5-9d61-11a89b10bab6 could not be found. Aug 31 19:23:43.939465 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:23:43.939465 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:23:43.939465 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:23:43.939465 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:23:43.939465 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:23:43.939465 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:23:43.939465 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:23:43.939465 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:23:43.939465 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:23:43.940959 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:23:43.940959 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:23:43.940959 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:23:43.940959 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:23:43.940959 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:23:43.940959 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:23:43.940959 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:23:43.940959 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db83c2c0-f1c0-40e5-9d61-11a89b10bab6 could not be found. Aug 31 19:23:43.940959 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:23:43.940959 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:23:43.940959 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:23:43.940959 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:23:43.940959 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:23:43.940959 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:23:43.940959 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:23:43.940959 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:23:43.940959 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db83c2c0-f1c0-40e5-9d61-11a89b10bab6 could not be found. Aug 31 19:23:43.940959 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:23:43.942372 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-51a006a5-dc36-4229-9258-ec563133d759 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Returning 404 to user: Instance db83c2c0-f1c0-40e5-9d61-11a89b10bab6 could not be found. {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:23:43.942372 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-51a006a5-dc36-4229-9258-ec563133d759 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/db83c2c0-f1c0-40e5-9d61-11a89b10bab6" status: 404 len: 111 microversion: 2.1 time: 0.029997 Aug 31 19:23:43.942372 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 507/1015] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:43 2022] GET /compute/v2.1/servers/db83c2c0-f1c0-40e5-9d61-11a89b10bab6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:23:43.946934 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-eda8712e-8daf-46c8-8618-39925ac9ce27 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '.version_select at 0x7fdb864fd280>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:43.966953 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-eda8712e-8daf-46c8-8618-39925ac9ce27 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1710187437" status: 202 len: 0 microversion: 2.1 time: 0.023721 Aug 31 19:23:43.967513 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 509/1016] 10.222.0.65 () {58 vars in 1221 bytes} [Wed Aug 31 19:23:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1710187437 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:23:44.255497 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-60b67bca-af04-4b58-b8a0-85ddbc7ea2a9 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:44.255693 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-60b67bca-af04-4b58-b8a0-85ddbc7ea2a9 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:44.263544 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-60b67bca-af04-4b58-b8a0-85ddbc7ea2a9 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:44.264115 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-60b67bca-af04-4b58-b8a0-85ddbc7ea2a9 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:44.264647 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-60b67bca-af04-4b58-b8a0-85ddbc7ea2a9 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:44.265443 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-60b67bca-af04-4b58-b8a0-85ddbc7ea2a9 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:44.265904 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-60b67bca-af04-4b58-b8a0-85ddbc7ea2a9 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:44.266401 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-60b67bca-af04-4b58-b8a0-85ddbc7ea2a9 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:44.470753 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-60b67bca-af04-4b58-b8a0-85ddbc7ea2a9 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:44.482458 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-60b67bca-af04-4b58-b8a0-85ddbc7ea2a9 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:44.485115 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-60b67bca-af04-4b58-b8a0-85ddbc7ea2a9 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:44.486803 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-60b67bca-af04-4b58-b8a0-85ddbc7ea2a9 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1806 microversion: 2.20 time: 0.236121 Aug 31 19:23:44.488231 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 508/1017] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:23:44 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1806 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:23:45.511058 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-a4d163d7-c14a-4d6e-ac76-dedd7710f49e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:45.511700 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-a4d163d7-c14a-4d6e-ac76-dedd7710f49e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:45.518206 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a4d163d7-c14a-4d6e-ac76-dedd7710f49e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:45.518690 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a4d163d7-c14a-4d6e-ac76-dedd7710f49e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:45.519122 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a4d163d7-c14a-4d6e-ac76-dedd7710f49e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:45.519809 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a4d163d7-c14a-4d6e-ac76-dedd7710f49e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:45.520266 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a4d163d7-c14a-4d6e-ac76-dedd7710f49e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:45.520694 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a4d163d7-c14a-4d6e-ac76-dedd7710f49e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:45.654732 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-a4d163d7-c14a-4d6e-ac76-dedd7710f49e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:45.663383 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-a4d163d7-c14a-4d6e-ac76-dedd7710f49e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:45.664823 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-a4d163d7-c14a-4d6e-ac76-dedd7710f49e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:45.666014 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-a4d163d7-c14a-4d6e-ac76-dedd7710f49e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1793 microversion: 2.20 time: 0.159438 Aug 31 19:23:45.666567 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 510/1018] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:23:45 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1793 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:23:45.850590 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-a93fc0aa-b705-47fb-b63a-d963630e3572 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:45.851073 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-a93fc0aa-b705-47fb-b63a-d963630e3572 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: db83c2c0-f1c0-40e5-9d61-11a89b10bab6] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:45.857561 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a93fc0aa-b705-47fb-b63a-d963630e3572 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:45.858046 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a93fc0aa-b705-47fb-b63a-d963630e3572 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:45.858477 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a93fc0aa-b705-47fb-b63a-d963630e3572 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:45.859167 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a93fc0aa-b705-47fb-b63a-d963630e3572 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:45.859630 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a93fc0aa-b705-47fb-b63a-d963630e3572 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:45.860054 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a93fc0aa-b705-47fb-b63a-d963630e3572 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:45.873280 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.wsgi [None req-a93fc0aa-b705-47fb-b63a-d963630e3572 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] HTTP exception thrown: Instance db83c2c0-f1c0-40e5-9d61-11a89b10bab6 could not be found. Aug 31 19:23:45.875305 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-a93fc0aa-b705-47fb-b63a-d963630e3572 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Request method failure captured: Aug 31 19:23:45.875305 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: request: DELETE /compute/v2.1/servers/db83c2c0-f1c0-40e5-9d61-11a89b10bab6 HTTP/1.1 Aug 31 19:23:45.875305 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept: application/json Aug 31 19:23:45.875305 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Aug 31 19:23:45.875305 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Connection: close Aug 31 19:23:45.875305 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Length: 0 Aug 31 19:23:45.875305 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Type: application/json Aug 31 19:23:45.875305 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Host: 10.222.0.65 Aug 31 19:23:45.875305 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Aug 31 19:23:45.875305 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Aug 31 19:23:45.875305 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjD7KQFx_CTgljpc_qTbwt7yeZ02hQJcRRTGjLujiMjCCm-y4KZuXdAcd8yicyJshoDc3mgcG2dVFxaRyv0OYT2U8p5W3ZDfvXP2qQyvl9GhMqVycMoUFtordGBMOd64j9xBsCCsuy7lF-JjelfCeTLgdgY5owS10WSU3cjBe8ulEuuUA Aug 31 19:23:45.875305 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Aug 31 19:23:45.875305 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Aug 31 19:23:45.875305 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Aug 31 19:23:45.875305 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Aug 31 19:23:45.875305 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Aug 31 19:23:45.875305 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Aug 31 19:23:45.875305 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Id: e6d782400f1e432c8d10a31334c42e68 Aug 31 19:23:45.875305 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-AttachVolumeNegativeTest-739769459 Aug 31 19:23:45.875305 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Role: member,reader Aug 31 19:23:45.875305 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Roles: member,reader Aug 31 19:23:45.876915 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/e6d782400f1e432c8d10a31334c42e68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e6d782400f1e432c8d10a31334c42e68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_e6d782400f1e432c8d10a31334c42e68", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e6d782400f1e432c8d10a31334c42e68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:23:45.876915 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-AttachVolumeNegativeTest-739769459 Aug 31 19:23:45.876915 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Id: e6d782400f1e432c8d10a31334c42e68 Aug 31 19:23:45.876915 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-739769459 Aug 31 19:23:45.876915 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User: tempest-AttachVolumeNegativeTest-739769459-project Aug 31 19:23:45.876915 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Aug 31 19:23:45.876915 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Aug 31 19:23:45.876915 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Id: 0bfa1533b0944bd681f4c2a33cf701b0 Aug 31 19:23:45.876915 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-AttachVolumeNegativeTest-739769459-project Aug 31 19:23:45.876915 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: method: > Aug 31 19:23:45.876915 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: exception: Instance db83c2c0-f1c0-40e5-9d61-11a89b10bab6 could not be found. Aug 31 19:23:45.876915 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: action_args: {'id': 'db83c2c0-f1c0-40e5-9d61-11a89b10bab6'} Aug 31 19:23:45.877893 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:23:45.877893 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:23:45.877893 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:23:45.877893 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:23:45.877893 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:23:45.877893 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:23:45.877893 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:23:45.877893 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:23:45.877893 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:23:45.877893 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:23:45.877893 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db83c2c0-f1c0-40e5-9d61-11a89b10bab6 could not be found. Aug 31 19:23:45.877893 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:23:45.877893 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:23:45.877893 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:23:45.877893 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:23:45.877893 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:23:45.877893 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:23:45.877893 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:23:45.877893 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:23:45.877893 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:23:45.879433 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:23:45.879433 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 19:23:45.879433 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 19:23:45.879433 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 19:23:45.879433 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 19:23:45.879433 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:23:45.879433 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:23:45.879433 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:23:45.879433 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:23:45.879433 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db83c2c0-f1c0-40e5-9d61-11a89b10bab6 could not be found. Aug 31 19:23:45.879433 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:23:45.879433 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:23:45.879433 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:23:45.879433 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:23:45.879433 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:23:45.879433 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:23:45.879433 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:23:45.879433 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:23:45.879433 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db83c2c0-f1c0-40e5-9d61-11a89b10bab6 could not be found. Aug 31 19:23:45.879433 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:23:45.881036 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-a93fc0aa-b705-47fb-b63a-d963630e3572 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Returning 404 to user: Instance db83c2c0-f1c0-40e5-9d61-11a89b10bab6 could not be found. {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:23:45.881036 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-a93fc0aa-b705-47fb-b63a-d963630e3572 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "DELETE /compute/v2.1/servers/db83c2c0-f1c0-40e5-9d61-11a89b10bab6" status: 404 len: 111 microversion: 2.1 time: 0.030104 Aug 31 19:23:45.881036 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 509/1019] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 31 19:23:45 2022] DELETE /compute/v2.1/servers/db83c2c0-f1c0-40e5-9d61-11a89b10bab6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:23:45.885048 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-1676aa4b-c705-43b3-a17c-822f6b9e98fe tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:45.885692 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-1676aa4b-c705-43b3-a17c-822f6b9e98fe tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: db83c2c0-f1c0-40e5-9d61-11a89b10bab6] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:45.892143 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1676aa4b-c705-43b3-a17c-822f6b9e98fe tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:45.892620 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1676aa4b-c705-43b3-a17c-822f6b9e98fe tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:45.893051 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1676aa4b-c705-43b3-a17c-822f6b9e98fe tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:45.893762 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1676aa4b-c705-43b3-a17c-822f6b9e98fe tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:45.894212 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1676aa4b-c705-43b3-a17c-822f6b9e98fe tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:45.894629 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1676aa4b-c705-43b3-a17c-822f6b9e98fe tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:45.907673 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.wsgi [None req-1676aa4b-c705-43b3-a17c-822f6b9e98fe tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] HTTP exception thrown: Instance db83c2c0-f1c0-40e5-9d61-11a89b10bab6 could not be found. Aug 31 19:23:45.909312 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-1676aa4b-c705-43b3-a17c-822f6b9e98fe tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Request method failure captured: Aug 31 19:23:45.909312 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: request: GET /compute/v2.1/servers/db83c2c0-f1c0-40e5-9d61-11a89b10bab6 HTTP/1.1 Aug 31 19:23:45.909312 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Accept: application/json Aug 31 19:23:45.909312 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Accept-Encoding: identity Aug 31 19:23:45.909312 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Connection: close Aug 31 19:23:45.909312 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Content-Length: 0 Aug 31 19:23:45.909312 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Content-Type: application/json Aug 31 19:23:45.909312 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Host: 10.222.0.65 Aug 31 19:23:45.909312 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Openstack-System-Scope: None Aug 31 19:23:45.909312 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: User-Agent: python-urllib3/1.26.12 Aug 31 19:23:45.909312 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Auth-Token: gAAAAABjD7KQFx_CTgljpc_qTbwt7yeZ02hQJcRRTGjLujiMjCCm-y4KZuXdAcd8yicyJshoDc3mgcG2dVFxaRyv0OYT2U8p5W3ZDfvXP2qQyvl9GhMqVycMoUFtordGBMOd64j9xBsCCsuy7lF-JjelfCeTLgdgY5owS10WSU3cjBe8ulEuuUA Aug 31 19:23:45.909312 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Domain-Id: None Aug 31 19:23:45.909312 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Domain-Name: None Aug 31 19:23:45.909312 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Identity-Status: Confirmed Aug 31 19:23:45.909312 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Is-Admin-Project: True Aug 31 19:23:45.909312 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Id: default Aug 31 19:23:45.909312 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Name: Default Aug 31 19:23:45.909312 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Id: e6d782400f1e432c8d10a31334c42e68 Aug 31 19:23:45.909312 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Name: tempest-AttachVolumeNegativeTest-739769459 Aug 31 19:23:45.909312 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Role: member,reader Aug 31 19:23:45.909312 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Roles: member,reader Aug 31 19:23:45.910927 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/e6d782400f1e432c8d10a31334c42e68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e6d782400f1e432c8d10a31334c42e68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_e6d782400f1e432c8d10a31334c42e68", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e6d782400f1e432c8d10a31334c42e68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:23:45.910927 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant: tempest-AttachVolumeNegativeTest-739769459 Aug 31 19:23:45.910927 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant-Id: e6d782400f1e432c8d10a31334c42e68 Aug 31 19:23:45.910927 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-739769459 Aug 31 19:23:45.910927 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User: tempest-AttachVolumeNegativeTest-739769459-project Aug 31 19:23:45.910927 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Id: default Aug 31 19:23:45.910927 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Name: Default Aug 31 19:23:45.910927 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Id: 0bfa1533b0944bd681f4c2a33cf701b0 Aug 31 19:23:45.910927 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Name: tempest-AttachVolumeNegativeTest-739769459-project Aug 31 19:23:45.910927 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: method: > Aug 31 19:23:45.910927 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: exception: Instance db83c2c0-f1c0-40e5-9d61-11a89b10bab6 could not be found. Aug 31 19:23:45.910927 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: action_args: {'id': 'db83c2c0-f1c0-40e5-9d61-11a89b10bab6'} Aug 31 19:23:45.911920 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:23:45.911920 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:23:45.911920 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:23:45.911920 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:23:45.911920 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:23:45.911920 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:23:45.911920 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:23:45.911920 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:23:45.911920 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:23:45.911920 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:23:45.911920 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db83c2c0-f1c0-40e5-9d61-11a89b10bab6 could not be found. Aug 31 19:23:45.911920 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:23:45.911920 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:23:45.911920 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:23:45.911920 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:23:45.911920 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:23:45.911920 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:23:45.911920 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:23:45.911920 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:23:45.911920 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:23:45.913483 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:23:45.913483 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:23:45.913483 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:23:45.913483 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:23:45.913483 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:23:45.913483 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:23:45.913483 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:23:45.913483 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db83c2c0-f1c0-40e5-9d61-11a89b10bab6 could not be found. Aug 31 19:23:45.913483 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:23:45.913483 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:23:45.913483 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:23:45.913483 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:23:45.913483 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:23:45.913483 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:23:45.913483 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:23:45.913483 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:23:45.913483 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db83c2c0-f1c0-40e5-9d61-11a89b10bab6 could not be found. Aug 31 19:23:45.913483 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:23:45.914810 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-1676aa4b-c705-43b3-a17c-822f6b9e98fe tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Returning 404 to user: Instance db83c2c0-f1c0-40e5-9d61-11a89b10bab6 could not be found. {{(pid=120623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:23:45.914810 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-1676aa4b-c705-43b3-a17c-822f6b9e98fe tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/db83c2c0-f1c0-40e5-9d61-11a89b10bab6" status: 404 len: 111 microversion: 2.1 time: 0.029435 Aug 31 19:23:45.914810 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 511/1020] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:45 2022] GET /compute/v2.1/servers/db83c2c0-f1c0-40e5-9d61-11a89b10bab6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:23:47.045291 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-b1beee86-73ab-4d6e-8b2e-1283dd4c74a1 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:47.045809 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-b1beee86-73ab-4d6e-8b2e-1283dd4c74a1 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: 0ae1a222-b48a-4e85-8c65-5d3dccd56f1e] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:47.052136 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b1beee86-73ab-4d6e-8b2e-1283dd4c74a1 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:47.052618 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b1beee86-73ab-4d6e-8b2e-1283dd4c74a1 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:47.053053 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b1beee86-73ab-4d6e-8b2e-1283dd4c74a1 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:47.053767 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b1beee86-73ab-4d6e-8b2e-1283dd4c74a1 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:47.054222 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b1beee86-73ab-4d6e-8b2e-1283dd4c74a1 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:47.054644 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b1beee86-73ab-4d6e-8b2e-1283dd4c74a1 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:47.068468 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.wsgi [None req-b1beee86-73ab-4d6e-8b2e-1283dd4c74a1 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] HTTP exception thrown: Instance 0ae1a222-b48a-4e85-8c65-5d3dccd56f1e could not be found. Aug 31 19:23:47.070024 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-b1beee86-73ab-4d6e-8b2e-1283dd4c74a1 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Request method failure captured: Aug 31 19:23:47.070024 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: request: DELETE /compute/v2.1/servers/0ae1a222-b48a-4e85-8c65-5d3dccd56f1e HTTP/1.1 Aug 31 19:23:47.070024 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept: application/json Aug 31 19:23:47.070024 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Aug 31 19:23:47.070024 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Connection: close Aug 31 19:23:47.070024 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Length: 0 Aug 31 19:23:47.070024 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Type: application/json Aug 31 19:23:47.070024 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Host: 10.222.0.65 Aug 31 19:23:47.070024 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Aug 31 19:23:47.070024 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Aug 31 19:23:47.070024 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjD7KQFx_CTgljpc_qTbwt7yeZ02hQJcRRTGjLujiMjCCm-y4KZuXdAcd8yicyJshoDc3mgcG2dVFxaRyv0OYT2U8p5W3ZDfvXP2qQyvl9GhMqVycMoUFtordGBMOd64j9xBsCCsuy7lF-JjelfCeTLgdgY5owS10WSU3cjBe8ulEuuUA Aug 31 19:23:47.070024 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Aug 31 19:23:47.070024 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Aug 31 19:23:47.070024 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Aug 31 19:23:47.070024 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Aug 31 19:23:47.070024 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Aug 31 19:23:47.070024 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Aug 31 19:23:47.070024 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Id: e6d782400f1e432c8d10a31334c42e68 Aug 31 19:23:47.070024 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-AttachVolumeNegativeTest-739769459 Aug 31 19:23:47.070024 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Role: member,reader Aug 31 19:23:47.070024 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Roles: member,reader Aug 31 19:23:47.071640 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/e6d782400f1e432c8d10a31334c42e68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e6d782400f1e432c8d10a31334c42e68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_e6d782400f1e432c8d10a31334c42e68", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e6d782400f1e432c8d10a31334c42e68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:23:47.071640 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-AttachVolumeNegativeTest-739769459 Aug 31 19:23:47.071640 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Id: e6d782400f1e432c8d10a31334c42e68 Aug 31 19:23:47.071640 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-739769459 Aug 31 19:23:47.071640 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User: tempest-AttachVolumeNegativeTest-739769459-project Aug 31 19:23:47.071640 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Aug 31 19:23:47.071640 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Aug 31 19:23:47.071640 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Id: 0bfa1533b0944bd681f4c2a33cf701b0 Aug 31 19:23:47.071640 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-AttachVolumeNegativeTest-739769459-project Aug 31 19:23:47.071640 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: method: > Aug 31 19:23:47.071640 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: exception: Instance 0ae1a222-b48a-4e85-8c65-5d3dccd56f1e could not be found. Aug 31 19:23:47.071640 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: action_args: {'id': '0ae1a222-b48a-4e85-8c65-5d3dccd56f1e'} Aug 31 19:23:47.072714 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:23:47.072714 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:23:47.072714 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:23:47.072714 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:23:47.072714 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:23:47.072714 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:23:47.072714 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:23:47.072714 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:23:47.072714 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:23:47.072714 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:23:47.072714 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ae1a222-b48a-4e85-8c65-5d3dccd56f1e could not be found. Aug 31 19:23:47.072714 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:23:47.072714 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:23:47.072714 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:23:47.072714 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:23:47.072714 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:23:47.072714 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:23:47.072714 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:23:47.072714 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:23:47.072714 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:23:47.074396 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:23:47.074396 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 19:23:47.074396 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 19:23:47.074396 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 19:23:47.074396 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 19:23:47.074396 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:23:47.074396 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:23:47.074396 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:23:47.074396 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:23:47.074396 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ae1a222-b48a-4e85-8c65-5d3dccd56f1e could not be found. Aug 31 19:23:47.074396 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:23:47.074396 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:23:47.074396 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:23:47.074396 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:23:47.074396 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:23:47.074396 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:23:47.074396 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:23:47.074396 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:23:47.074396 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ae1a222-b48a-4e85-8c65-5d3dccd56f1e could not be found. Aug 31 19:23:47.074396 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:23:47.076020 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-b1beee86-73ab-4d6e-8b2e-1283dd4c74a1 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Returning 404 to user: Instance 0ae1a222-b48a-4e85-8c65-5d3dccd56f1e could not be found. {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:23:47.076020 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-b1beee86-73ab-4d6e-8b2e-1283dd4c74a1 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "DELETE /compute/v2.1/servers/0ae1a222-b48a-4e85-8c65-5d3dccd56f1e" status: 404 len: 111 microversion: 2.1 time: 0.029986 Aug 31 19:23:47.076020 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 510/1021] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 31 19:23:47 2022] DELETE /compute/v2.1/servers/0ae1a222-b48a-4e85-8c65-5d3dccd56f1e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:23:47.081257 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-b82cff77-20eb-4e3b-b906-bddcbbbc6f92 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:47.081826 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-b82cff77-20eb-4e3b-b906-bddcbbbc6f92 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: 0ae1a222-b48a-4e85-8c65-5d3dccd56f1e] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:47.088210 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b82cff77-20eb-4e3b-b906-bddcbbbc6f92 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:47.088689 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b82cff77-20eb-4e3b-b906-bddcbbbc6f92 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:47.089128 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b82cff77-20eb-4e3b-b906-bddcbbbc6f92 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:47.089834 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b82cff77-20eb-4e3b-b906-bddcbbbc6f92 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:47.090281 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b82cff77-20eb-4e3b-b906-bddcbbbc6f92 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:47.090696 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b82cff77-20eb-4e3b-b906-bddcbbbc6f92 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:47.104105 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.wsgi [None req-b82cff77-20eb-4e3b-b906-bddcbbbc6f92 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] HTTP exception thrown: Instance 0ae1a222-b48a-4e85-8c65-5d3dccd56f1e could not be found. Aug 31 19:23:47.105653 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-b82cff77-20eb-4e3b-b906-bddcbbbc6f92 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Request method failure captured: Aug 31 19:23:47.105653 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: request: GET /compute/v2.1/servers/0ae1a222-b48a-4e85-8c65-5d3dccd56f1e HTTP/1.1 Aug 31 19:23:47.105653 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Accept: application/json Aug 31 19:23:47.105653 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Accept-Encoding: identity Aug 31 19:23:47.105653 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Connection: close Aug 31 19:23:47.105653 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Content-Length: 0 Aug 31 19:23:47.105653 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Content-Type: application/json Aug 31 19:23:47.105653 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Host: 10.222.0.65 Aug 31 19:23:47.105653 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Openstack-System-Scope: None Aug 31 19:23:47.105653 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: User-Agent: python-urllib3/1.26.12 Aug 31 19:23:47.105653 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Auth-Token: gAAAAABjD7KQFx_CTgljpc_qTbwt7yeZ02hQJcRRTGjLujiMjCCm-y4KZuXdAcd8yicyJshoDc3mgcG2dVFxaRyv0OYT2U8p5W3ZDfvXP2qQyvl9GhMqVycMoUFtordGBMOd64j9xBsCCsuy7lF-JjelfCeTLgdgY5owS10WSU3cjBe8ulEuuUA Aug 31 19:23:47.105653 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Domain-Id: None Aug 31 19:23:47.105653 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Domain-Name: None Aug 31 19:23:47.105653 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Identity-Status: Confirmed Aug 31 19:23:47.105653 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Is-Admin-Project: True Aug 31 19:23:47.105653 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Id: default Aug 31 19:23:47.105653 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Name: Default Aug 31 19:23:47.105653 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Id: e6d782400f1e432c8d10a31334c42e68 Aug 31 19:23:47.105653 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Name: tempest-AttachVolumeNegativeTest-739769459 Aug 31 19:23:47.105653 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Role: member,reader Aug 31 19:23:47.105653 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Roles: member,reader Aug 31 19:23:47.107292 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/e6d782400f1e432c8d10a31334c42e68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e6d782400f1e432c8d10a31334c42e68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_e6d782400f1e432c8d10a31334c42e68", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e6d782400f1e432c8d10a31334c42e68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:23:47.107292 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant: tempest-AttachVolumeNegativeTest-739769459 Aug 31 19:23:47.107292 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant-Id: e6d782400f1e432c8d10a31334c42e68 Aug 31 19:23:47.107292 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-739769459 Aug 31 19:23:47.107292 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User: tempest-AttachVolumeNegativeTest-739769459-project Aug 31 19:23:47.107292 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Id: default Aug 31 19:23:47.107292 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Name: Default Aug 31 19:23:47.107292 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Id: 0bfa1533b0944bd681f4c2a33cf701b0 Aug 31 19:23:47.107292 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Name: tempest-AttachVolumeNegativeTest-739769459-project Aug 31 19:23:47.107292 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: method: > Aug 31 19:23:47.107292 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: exception: Instance 0ae1a222-b48a-4e85-8c65-5d3dccd56f1e could not be found. Aug 31 19:23:47.107292 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: action_args: {'id': '0ae1a222-b48a-4e85-8c65-5d3dccd56f1e'} Aug 31 19:23:47.108398 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:23:47.108398 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:23:47.108398 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:23:47.108398 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:23:47.108398 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:23:47.108398 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:23:47.108398 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:23:47.108398 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:23:47.108398 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:23:47.108398 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:23:47.108398 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ae1a222-b48a-4e85-8c65-5d3dccd56f1e could not be found. Aug 31 19:23:47.108398 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:23:47.108398 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:23:47.108398 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:23:47.108398 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:23:47.108398 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:23:47.108398 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:23:47.108398 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:23:47.108398 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:23:47.108398 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:23:47.110055 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:23:47.110055 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:23:47.110055 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:23:47.110055 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:23:47.110055 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:23:47.110055 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:23:47.110055 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:23:47.110055 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ae1a222-b48a-4e85-8c65-5d3dccd56f1e could not be found. Aug 31 19:23:47.110055 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:23:47.110055 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:23:47.110055 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:23:47.110055 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:23:47.110055 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:23:47.110055 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:23:47.110055 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:23:47.110055 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:23:47.110055 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ae1a222-b48a-4e85-8c65-5d3dccd56f1e could not be found. Aug 31 19:23:47.110055 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:23:47.111722 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-b82cff77-20eb-4e3b-b906-bddcbbbc6f92 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Returning 404 to user: Instance 0ae1a222-b48a-4e85-8c65-5d3dccd56f1e could not be found. {{(pid=120623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:23:47.111722 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-b82cff77-20eb-4e3b-b906-bddcbbbc6f92 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/0ae1a222-b48a-4e85-8c65-5d3dccd56f1e" status: 404 len: 111 microversion: 2.1 time: 0.030519 Aug 31 19:23:47.111722 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 512/1022] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:47 2022] GET /compute/v2.1/servers/0ae1a222-b48a-4e85-8c65-5d3dccd56f1e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:23:47.115172 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-03fdc47a-0674-4974-acfe-5d9066af295c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:47.115667 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-03fdc47a-0674-4974-acfe-5d9066af295c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: f7d66e43-86cd-49c9-9bf0-09489b7fd178] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:47.121694 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-03fdc47a-0674-4974-acfe-5d9066af295c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:47.122175 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-03fdc47a-0674-4974-acfe-5d9066af295c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:47.122609 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-03fdc47a-0674-4974-acfe-5d9066af295c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:47.123295 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-03fdc47a-0674-4974-acfe-5d9066af295c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:47.123747 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-03fdc47a-0674-4974-acfe-5d9066af295c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:47.124168 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-03fdc47a-0674-4974-acfe-5d9066af295c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:47.138315 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.wsgi [None req-03fdc47a-0674-4974-acfe-5d9066af295c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] HTTP exception thrown: Instance f7d66e43-86cd-49c9-9bf0-09489b7fd178 could not be found. Aug 31 19:23:47.139847 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-03fdc47a-0674-4974-acfe-5d9066af295c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Request method failure captured: Aug 31 19:23:47.139847 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: request: DELETE /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178 HTTP/1.1 Aug 31 19:23:47.139847 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept: application/json Aug 31 19:23:47.139847 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Aug 31 19:23:47.139847 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Connection: close Aug 31 19:23:47.139847 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Length: 0 Aug 31 19:23:47.139847 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Type: application/json Aug 31 19:23:47.139847 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Host: 10.222.0.65 Aug 31 19:23:47.139847 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Aug 31 19:23:47.139847 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Aug 31 19:23:47.139847 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjD7KQFx_CTgljpc_qTbwt7yeZ02hQJcRRTGjLujiMjCCm-y4KZuXdAcd8yicyJshoDc3mgcG2dVFxaRyv0OYT2U8p5W3ZDfvXP2qQyvl9GhMqVycMoUFtordGBMOd64j9xBsCCsuy7lF-JjelfCeTLgdgY5owS10WSU3cjBe8ulEuuUA Aug 31 19:23:47.139847 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Aug 31 19:23:47.139847 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Aug 31 19:23:47.139847 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Aug 31 19:23:47.139847 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Aug 31 19:23:47.139847 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Aug 31 19:23:47.139847 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Aug 31 19:23:47.139847 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Id: e6d782400f1e432c8d10a31334c42e68 Aug 31 19:23:47.139847 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-AttachVolumeNegativeTest-739769459 Aug 31 19:23:47.139847 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Role: member,reader Aug 31 19:23:47.139847 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Roles: member,reader Aug 31 19:23:47.142098 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/e6d782400f1e432c8d10a31334c42e68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e6d782400f1e432c8d10a31334c42e68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_e6d782400f1e432c8d10a31334c42e68", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e6d782400f1e432c8d10a31334c42e68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:23:47.142098 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-AttachVolumeNegativeTest-739769459 Aug 31 19:23:47.142098 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Id: e6d782400f1e432c8d10a31334c42e68 Aug 31 19:23:47.142098 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-739769459 Aug 31 19:23:47.142098 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User: tempest-AttachVolumeNegativeTest-739769459-project Aug 31 19:23:47.142098 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Aug 31 19:23:47.142098 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Aug 31 19:23:47.142098 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Id: 0bfa1533b0944bd681f4c2a33cf701b0 Aug 31 19:23:47.142098 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-AttachVolumeNegativeTest-739769459-project Aug 31 19:23:47.142098 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: method: > Aug 31 19:23:47.142098 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: exception: Instance f7d66e43-86cd-49c9-9bf0-09489b7fd178 could not be found. Aug 31 19:23:47.142098 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: action_args: {'id': 'f7d66e43-86cd-49c9-9bf0-09489b7fd178'} Aug 31 19:23:47.143161 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:23:47.143161 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:23:47.143161 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:23:47.143161 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:23:47.143161 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:23:47.143161 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:23:47.143161 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:23:47.143161 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:23:47.143161 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:23:47.143161 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:23:47.143161 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7d66e43-86cd-49c9-9bf0-09489b7fd178 could not be found. Aug 31 19:23:47.143161 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:23:47.143161 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:23:47.143161 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:23:47.143161 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:23:47.143161 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:23:47.143161 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:23:47.143161 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:23:47.143161 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:23:47.143161 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:23:47.144792 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:23:47.144792 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 19:23:47.144792 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 19:23:47.144792 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 19:23:47.144792 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 19:23:47.144792 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:23:47.144792 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:23:47.144792 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:23:47.144792 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:23:47.144792 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7d66e43-86cd-49c9-9bf0-09489b7fd178 could not be found. Aug 31 19:23:47.144792 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:23:47.144792 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:23:47.144792 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:23:47.144792 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:23:47.144792 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:23:47.144792 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:23:47.144792 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:23:47.144792 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:23:47.144792 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7d66e43-86cd-49c9-9bf0-09489b7fd178 could not be found. Aug 31 19:23:47.144792 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:23:47.146443 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-03fdc47a-0674-4974-acfe-5d9066af295c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Returning 404 to user: Instance f7d66e43-86cd-49c9-9bf0-09489b7fd178 could not be found. {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:23:47.146443 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-03fdc47a-0674-4974-acfe-5d9066af295c tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "DELETE /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178" status: 404 len: 111 microversion: 2.1 time: 0.030392 Aug 31 19:23:47.146443 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 511/1023] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 31 19:23:47 2022] DELETE /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:23:47.149830 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-c7780162-3d5d-408c-8d15-1b0e9ba762d3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:47.150441 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-c7780162-3d5d-408c-8d15-1b0e9ba762d3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: f7d66e43-86cd-49c9-9bf0-09489b7fd178] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:47.156319 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c7780162-3d5d-408c-8d15-1b0e9ba762d3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:47.156803 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c7780162-3d5d-408c-8d15-1b0e9ba762d3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:47.157266 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c7780162-3d5d-408c-8d15-1b0e9ba762d3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:47.157945 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c7780162-3d5d-408c-8d15-1b0e9ba762d3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:47.158392 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c7780162-3d5d-408c-8d15-1b0e9ba762d3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:47.158809 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c7780162-3d5d-408c-8d15-1b0e9ba762d3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:47.171927 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.wsgi [None req-c7780162-3d5d-408c-8d15-1b0e9ba762d3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] HTTP exception thrown: Instance f7d66e43-86cd-49c9-9bf0-09489b7fd178 could not be found. Aug 31 19:23:47.173447 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-c7780162-3d5d-408c-8d15-1b0e9ba762d3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Request method failure captured: Aug 31 19:23:47.173447 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: request: GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178 HTTP/1.1 Aug 31 19:23:47.173447 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Accept: application/json Aug 31 19:23:47.173447 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Accept-Encoding: identity Aug 31 19:23:47.173447 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Connection: close Aug 31 19:23:47.173447 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Content-Length: 0 Aug 31 19:23:47.173447 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Content-Type: application/json Aug 31 19:23:47.173447 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Host: 10.222.0.65 Aug 31 19:23:47.173447 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Openstack-System-Scope: None Aug 31 19:23:47.173447 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: User-Agent: python-urllib3/1.26.12 Aug 31 19:23:47.173447 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Auth-Token: gAAAAABjD7KQFx_CTgljpc_qTbwt7yeZ02hQJcRRTGjLujiMjCCm-y4KZuXdAcd8yicyJshoDc3mgcG2dVFxaRyv0OYT2U8p5W3ZDfvXP2qQyvl9GhMqVycMoUFtordGBMOd64j9xBsCCsuy7lF-JjelfCeTLgdgY5owS10WSU3cjBe8ulEuuUA Aug 31 19:23:47.173447 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Domain-Id: None Aug 31 19:23:47.173447 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Domain-Name: None Aug 31 19:23:47.173447 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Identity-Status: Confirmed Aug 31 19:23:47.173447 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Is-Admin-Project: True Aug 31 19:23:47.173447 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Id: default Aug 31 19:23:47.173447 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Name: Default Aug 31 19:23:47.173447 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Id: e6d782400f1e432c8d10a31334c42e68 Aug 31 19:23:47.173447 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Name: tempest-AttachVolumeNegativeTest-739769459 Aug 31 19:23:47.173447 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Role: member,reader Aug 31 19:23:47.173447 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Roles: member,reader Aug 31 19:23:47.175077 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/e6d782400f1e432c8d10a31334c42e68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e6d782400f1e432c8d10a31334c42e68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_e6d782400f1e432c8d10a31334c42e68", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e6d782400f1e432c8d10a31334c42e68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:23:47.175077 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant: tempest-AttachVolumeNegativeTest-739769459 Aug 31 19:23:47.175077 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant-Id: e6d782400f1e432c8d10a31334c42e68 Aug 31 19:23:47.175077 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-739769459 Aug 31 19:23:47.175077 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User: tempest-AttachVolumeNegativeTest-739769459-project Aug 31 19:23:47.175077 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Id: default Aug 31 19:23:47.175077 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Name: Default Aug 31 19:23:47.175077 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Id: 0bfa1533b0944bd681f4c2a33cf701b0 Aug 31 19:23:47.175077 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Name: tempest-AttachVolumeNegativeTest-739769459-project Aug 31 19:23:47.175077 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: method: > Aug 31 19:23:47.175077 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: exception: Instance f7d66e43-86cd-49c9-9bf0-09489b7fd178 could not be found. Aug 31 19:23:47.175077 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: action_args: {'id': 'f7d66e43-86cd-49c9-9bf0-09489b7fd178'} Aug 31 19:23:47.175896 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:23:47.175896 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:23:47.175896 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:23:47.175896 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:23:47.175896 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:23:47.175896 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:23:47.175896 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:23:47.175896 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:23:47.175896 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:23:47.175896 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:23:47.175896 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7d66e43-86cd-49c9-9bf0-09489b7fd178 could not be found. Aug 31 19:23:47.175896 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:23:47.175896 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:23:47.175896 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:23:47.175896 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:23:47.175896 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:23:47.175896 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:23:47.175896 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:23:47.175896 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:23:47.175896 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:23:47.177127 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:23:47.177127 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:23:47.177127 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:23:47.177127 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:23:47.177127 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:23:47.177127 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:23:47.177127 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:23:47.177127 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7d66e43-86cd-49c9-9bf0-09489b7fd178 could not be found. Aug 31 19:23:47.177127 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:23:47.177127 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:23:47.177127 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:23:47.177127 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:23:47.177127 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:23:47.177127 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:23:47.177127 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:23:47.177127 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:23:47.177127 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7d66e43-86cd-49c9-9bf0-09489b7fd178 could not be found. Aug 31 19:23:47.177127 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:23:47.178578 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-c7780162-3d5d-408c-8d15-1b0e9ba762d3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Returning 404 to user: Instance f7d66e43-86cd-49c9-9bf0-09489b7fd178 could not be found. {{(pid=120623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:23:47.178578 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-c7780162-3d5d-408c-8d15-1b0e9ba762d3 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178" status: 404 len: 111 microversion: 2.1 time: 0.028792 Aug 31 19:23:47.178578 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 513/1024] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:47 2022] GET /compute/v2.1/servers/f7d66e43-86cd-49c9-9bf0-09489b7fd178 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:23:48.310175 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-86236a18-87bb-4162-b808-62eaf4149c2e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:48.310665 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-86236a18-87bb-4162-b808-62eaf4149c2e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:48.316964 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-86236a18-87bb-4162-b808-62eaf4149c2e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:48.317462 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-86236a18-87bb-4162-b808-62eaf4149c2e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:48.317884 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-86236a18-87bb-4162-b808-62eaf4149c2e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:48.318556 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-86236a18-87bb-4162-b808-62eaf4149c2e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:48.319055 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-86236a18-87bb-4162-b808-62eaf4149c2e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:48.319470 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-86236a18-87bb-4162-b808-62eaf4149c2e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:48.334810 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.wsgi [None req-86236a18-87bb-4162-b808-62eaf4149c2e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] HTTP exception thrown: Instance e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb could not be found. Aug 31 19:23:48.336318 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-86236a18-87bb-4162-b808-62eaf4149c2e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Request method failure captured: Aug 31 19:23:48.336318 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: request: DELETE /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb HTTP/1.1 Aug 31 19:23:48.336318 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept: application/json Aug 31 19:23:48.336318 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Aug 31 19:23:48.336318 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Connection: close Aug 31 19:23:48.336318 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Length: 0 Aug 31 19:23:48.336318 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Type: application/json Aug 31 19:23:48.336318 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Host: 10.222.0.65 Aug 31 19:23:48.336318 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Aug 31 19:23:48.336318 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Aug 31 19:23:48.336318 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjD7KQFx_CTgljpc_qTbwt7yeZ02hQJcRRTGjLujiMjCCm-y4KZuXdAcd8yicyJshoDc3mgcG2dVFxaRyv0OYT2U8p5W3ZDfvXP2qQyvl9GhMqVycMoUFtordGBMOd64j9xBsCCsuy7lF-JjelfCeTLgdgY5owS10WSU3cjBe8ulEuuUA Aug 31 19:23:48.336318 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Aug 31 19:23:48.336318 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Aug 31 19:23:48.336318 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Aug 31 19:23:48.336318 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Aug 31 19:23:48.336318 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Aug 31 19:23:48.336318 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Aug 31 19:23:48.336318 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Id: e6d782400f1e432c8d10a31334c42e68 Aug 31 19:23:48.336318 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-AttachVolumeNegativeTest-739769459 Aug 31 19:23:48.336318 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Role: member,reader Aug 31 19:23:48.336318 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Roles: member,reader Aug 31 19:23:48.338054 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/e6d782400f1e432c8d10a31334c42e68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e6d782400f1e432c8d10a31334c42e68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_e6d782400f1e432c8d10a31334c42e68", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e6d782400f1e432c8d10a31334c42e68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:23:48.338054 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-AttachVolumeNegativeTest-739769459 Aug 31 19:23:48.338054 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Id: e6d782400f1e432c8d10a31334c42e68 Aug 31 19:23:48.338054 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-739769459 Aug 31 19:23:48.338054 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User: tempest-AttachVolumeNegativeTest-739769459-project Aug 31 19:23:48.338054 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Aug 31 19:23:48.338054 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Aug 31 19:23:48.338054 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Id: 0bfa1533b0944bd681f4c2a33cf701b0 Aug 31 19:23:48.338054 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-AttachVolumeNegativeTest-739769459-project Aug 31 19:23:48.338054 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: method: > Aug 31 19:23:48.338054 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: exception: Instance e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb could not be found. Aug 31 19:23:48.338054 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: action_args: {'id': 'e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb'} Aug 31 19:23:48.338950 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:23:48.338950 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:23:48.338950 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:23:48.338950 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:23:48.338950 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:23:48.338950 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:23:48.338950 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:23:48.338950 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:23:48.338950 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:23:48.338950 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:23:48.338950 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb could not be found. Aug 31 19:23:48.338950 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:23:48.338950 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:23:48.338950 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:23:48.338950 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:23:48.338950 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:23:48.338950 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:23:48.338950 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:23:48.338950 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:23:48.338950 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:23:48.340429 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:23:48.340429 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 19:23:48.340429 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 19:23:48.340429 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 19:23:48.340429 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 19:23:48.340429 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:23:48.340429 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:23:48.340429 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:23:48.340429 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:23:48.340429 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb could not be found. Aug 31 19:23:48.340429 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:23:48.340429 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:23:48.340429 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:23:48.340429 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:23:48.340429 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:23:48.340429 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:23:48.340429 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:23:48.340429 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:23:48.340429 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb could not be found. Aug 31 19:23:48.340429 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:23:48.341882 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-86236a18-87bb-4162-b808-62eaf4149c2e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Returning 404 to user: Instance e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb could not be found. {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:23:48.341882 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-86236a18-87bb-4162-b808-62eaf4149c2e tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "DELETE /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 404 len: 111 microversion: 2.1 time: 0.031309 Aug 31 19:23:48.341882 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 512/1025] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 31 19:23:48 2022] DELETE /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:23:48.347125 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-f2a18f89-6c7d-4264-84e1-7d478c31b300 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:48.347773 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-f2a18f89-6c7d-4264-84e1-7d478c31b300 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] [instance: e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:48.354209 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f2a18f89-6c7d-4264-84e1-7d478c31b300 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:48.354694 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f2a18f89-6c7d-4264-84e1-7d478c31b300 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:48.355130 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f2a18f89-6c7d-4264-84e1-7d478c31b300 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:48.355815 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f2a18f89-6c7d-4264-84e1-7d478c31b300 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:48.356270 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f2a18f89-6c7d-4264-84e1-7d478c31b300 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:48.356693 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f2a18f89-6c7d-4264-84e1-7d478c31b300 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:48.369819 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.wsgi [None req-f2a18f89-6c7d-4264-84e1-7d478c31b300 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] HTTP exception thrown: Instance e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb could not be found. Aug 31 19:23:48.371316 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-f2a18f89-6c7d-4264-84e1-7d478c31b300 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Request method failure captured: Aug 31 19:23:48.371316 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: request: GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb HTTP/1.1 Aug 31 19:23:48.371316 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Accept: application/json Aug 31 19:23:48.371316 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Accept-Encoding: identity Aug 31 19:23:48.371316 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Connection: close Aug 31 19:23:48.371316 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Content-Length: 0 Aug 31 19:23:48.371316 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Content-Type: application/json Aug 31 19:23:48.371316 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Host: 10.222.0.65 Aug 31 19:23:48.371316 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Openstack-System-Scope: None Aug 31 19:23:48.371316 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: User-Agent: python-urllib3/1.26.12 Aug 31 19:23:48.371316 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Auth-Token: gAAAAABjD7KQFx_CTgljpc_qTbwt7yeZ02hQJcRRTGjLujiMjCCm-y4KZuXdAcd8yicyJshoDc3mgcG2dVFxaRyv0OYT2U8p5W3ZDfvXP2qQyvl9GhMqVycMoUFtordGBMOd64j9xBsCCsuy7lF-JjelfCeTLgdgY5owS10WSU3cjBe8ulEuuUA Aug 31 19:23:48.371316 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Domain-Id: None Aug 31 19:23:48.371316 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Domain-Name: None Aug 31 19:23:48.371316 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Identity-Status: Confirmed Aug 31 19:23:48.371316 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Is-Admin-Project: True Aug 31 19:23:48.371316 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Id: default Aug 31 19:23:48.371316 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Name: Default Aug 31 19:23:48.371316 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Id: e6d782400f1e432c8d10a31334c42e68 Aug 31 19:23:48.371316 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Name: tempest-AttachVolumeNegativeTest-739769459 Aug 31 19:23:48.371316 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Role: member,reader Aug 31 19:23:48.371316 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Roles: member,reader Aug 31 19:23:48.372891 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/e6d782400f1e432c8d10a31334c42e68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e6d782400f1e432c8d10a31334c42e68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_e6d782400f1e432c8d10a31334c42e68", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e6d782400f1e432c8d10a31334c42e68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:23:48.372891 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant: tempest-AttachVolumeNegativeTest-739769459 Aug 31 19:23:48.372891 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant-Id: e6d782400f1e432c8d10a31334c42e68 Aug 31 19:23:48.372891 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-739769459 Aug 31 19:23:48.372891 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User: tempest-AttachVolumeNegativeTest-739769459-project Aug 31 19:23:48.372891 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Id: default Aug 31 19:23:48.372891 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Name: Default Aug 31 19:23:48.372891 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Id: 0bfa1533b0944bd681f4c2a33cf701b0 Aug 31 19:23:48.372891 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Name: tempest-AttachVolumeNegativeTest-739769459-project Aug 31 19:23:48.372891 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: method: > Aug 31 19:23:48.372891 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: exception: Instance e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb could not be found. Aug 31 19:23:48.372891 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: action_args: {'id': 'e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb'} Aug 31 19:23:48.373846 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:23:48.373846 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:23:48.373846 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:23:48.373846 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:23:48.373846 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:23:48.373846 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:23:48.373846 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:23:48.373846 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:23:48.373846 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:23:48.373846 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:23:48.373846 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb could not be found. Aug 31 19:23:48.373846 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:23:48.373846 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:23:48.373846 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:23:48.373846 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:23:48.373846 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:23:48.373846 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:23:48.373846 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:23:48.373846 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:23:48.373846 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:23:48.375431 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:23:48.375431 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:23:48.375431 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:23:48.375431 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:23:48.375431 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:23:48.375431 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:23:48.375431 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:23:48.375431 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb could not be found. Aug 31 19:23:48.375431 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:23:48.375431 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:23:48.375431 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:23:48.375431 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:23:48.375431 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:23:48.375431 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:23:48.375431 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:23:48.375431 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:23:48.375431 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb could not be found. Aug 31 19:23:48.375431 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:23:48.376764 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-f2a18f89-6c7d-4264-84e1-7d478c31b300 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] Returning 404 to user: Instance e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb could not be found. {{(pid=120623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:23:48.376764 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-f2a18f89-6c7d-4264-84e1-7d478c31b300 tempest-AttachVolumeNegativeTest-739769459 tempest-AttachVolumeNegativeTest-739769459-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb" status: 404 len: 111 microversion: 2.1 time: 0.030363 Aug 31 19:23:48.376764 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 514/1026] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:48 2022] GET /compute/v2.1/servers/e5d9d8ce-c71d-4a06-8f7f-7f9ca829cacb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 19:24:41.012611 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-11358f12-4f17-4c33-98b2-272893577f84 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:41.013294 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-11358f12-4f17-4c33-98b2-272893577f84 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:41.015256 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_api:SELECT=15 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:41.015910 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=29 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:41.016678 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 19:24:41.016824 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Wed Aug 31 19:24:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05/os-volume_attachments/4aee0b9f-7092-4e21-8103-c428599086c8 (ip 10.222.0.65) !!! Aug 31 19:24:41.024441 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-11358f12-4f17-4c33-98b2-272893577f84 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:41.024917 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-11358f12-4f17-4c33-98b2-272893577f84 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:41.025380 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-11358f12-4f17-4c33-98b2-272893577f84 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:41.026075 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-11358f12-4f17-4c33-98b2-272893577f84 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:41.026522 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-11358f12-4f17-4c33-98b2-272893577f84 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:41.026937 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-11358f12-4f17-4c33-98b2-272893577f84 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:41.057256 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-11358f12-4f17-4c33-98b2-272893577f84 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05/os-volume_attachments/4aee0b9f-7092-4e21-8103-c428599086c8" status: 200 len: 194 microversion: 2.20 time: 0.048755 Aug 31 19:24:41.057829 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 513/1027] 10.222.0.65 () {60 vars in 1454 bytes} [Wed Aug 31 19:24:41 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05/os-volume_attachments/4aee0b9f-7092-4e21-8103-c428599086c8 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 19:24:41.124165 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-8b1c537d-8a98-48e9-8cfe-e7044eb3afee tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:41.124675 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-8b1c537d-8a98-48e9-8cfe-e7044eb3afee tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:41.126822 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:41.127460 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:41.128244 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 19:24:41.128391 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Wed Aug 31 19:24:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05/os-volume_attachments/4aee0b9f-7092-4e21-8103-c428599086c8 (ip 10.222.0.65) !!! Aug 31 19:24:41.137614 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8b1c537d-8a98-48e9-8cfe-e7044eb3afee tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:41.138649 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8b1c537d-8a98-48e9-8cfe-e7044eb3afee tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:41.139089 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8b1c537d-8a98-48e9-8cfe-e7044eb3afee tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:41.139790 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8b1c537d-8a98-48e9-8cfe-e7044eb3afee tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:41.140247 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8b1c537d-8a98-48e9-8cfe-e7044eb3afee tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:41.140699 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8b1c537d-8a98-48e9-8cfe-e7044eb3afee tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:41.222581 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.objects.instance [None req-8b1c537d-8a98-48e9-8cfe-e7044eb3afee tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lazy-loading 'services' on Instance uuid 5ff90966-a8dd-41ae-848d-e155bf217b05 {{(pid=120623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:24:41.293033 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-8b1c537d-8a98-48e9-8cfe-e7044eb3afee tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "DELETE /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05/os-volume_attachments/4aee0b9f-7092-4e21-8103-c428599086c8" status: 202 len: 0 microversion: 2.20 time: 0.172973 Aug 31 19:24:41.293640 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 515/1028] 10.222.0.65 () {60 vars in 1457 bytes} [Wed Aug 31 19:24:41 2022] DELETE /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05/os-volume_attachments/4aee0b9f-7092-4e21-8103-c428599086c8 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:24:41.302044 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-13be78f5-de9b-4c59-beed-3884512f0d4e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:41.304463 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-13be78f5-de9b-4c59-beed-3884512f0d4e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:41.311380 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-13be78f5-de9b-4c59-beed-3884512f0d4e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:41.312069 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-13be78f5-de9b-4c59-beed-3884512f0d4e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:41.312670 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-13be78f5-de9b-4c59-beed-3884512f0d4e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:41.313620 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-13be78f5-de9b-4c59-beed-3884512f0d4e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:41.314036 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-13be78f5-de9b-4c59-beed-3884512f0d4e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:41.314587 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-13be78f5-de9b-4c59-beed-3884512f0d4e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:41.346486 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-13be78f5-de9b-4c59-beed-3884512f0d4e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048289 Aug 31 19:24:41.347053 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 514/1029] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Aug 31 19:24:41 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 19:24:42.360187 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-c4877338-3a30-415e-bbd8-cb7222d4a874 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:42.362556 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-c4877338-3a30-415e-bbd8-cb7222d4a874 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:42.368679 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c4877338-3a30-415e-bbd8-cb7222d4a874 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:42.369155 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c4877338-3a30-415e-bbd8-cb7222d4a874 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:42.369619 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c4877338-3a30-415e-bbd8-cb7222d4a874 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:42.370292 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c4877338-3a30-415e-bbd8-cb7222d4a874 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:42.370737 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c4877338-3a30-415e-bbd8-cb7222d4a874 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:42.371150 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c4877338-3a30-415e-bbd8-cb7222d4a874 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:42.400115 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-c4877338-3a30-415e-bbd8-cb7222d4a874 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044769 Aug 31 19:24:42.400652 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 516/1030] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Aug 31 19:24:42 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:24:42.477789 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-31d3c184-a335-41a2-b727-675da9f8d546 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:42.478337 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-31d3c184-a335-41a2-b727-675da9f8d546 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:42.484867 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-31d3c184-a335-41a2-b727-675da9f8d546 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:42.485399 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-31d3c184-a335-41a2-b727-675da9f8d546 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:42.485834 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-31d3c184-a335-41a2-b727-675da9f8d546 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:42.486525 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-31d3c184-a335-41a2-b727-675da9f8d546 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:42.486977 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-31d3c184-a335-41a2-b727-675da9f8d546 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:42.487399 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-31d3c184-a335-41a2-b727-675da9f8d546 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:42.513108 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-31d3c184-a335-41a2-b727-675da9f8d546 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Going to try to terminate instance {{(pid=120624) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 19:24:42.586939 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-31d3c184-a335-41a2-b727-675da9f8d546 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "DELETE /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 204 len: 0 microversion: 2.20 time: 0.112741 Aug 31 19:24:42.587509 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 515/1031] 10.222.0.65 () {60 vars in 1280 bytes} [Wed Aug 31 19:24:42 2022] DELETE /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 19:24:42.595907 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-766e316f-b7f6-4723-aacf-497a2fe53b5c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:42.596517 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-766e316f-b7f6-4723-aacf-497a2fe53b5c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:42.602499 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-766e316f-b7f6-4723-aacf-497a2fe53b5c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:42.602985 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-766e316f-b7f6-4723-aacf-497a2fe53b5c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:42.603437 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-766e316f-b7f6-4723-aacf-497a2fe53b5c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:42.604116 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-766e316f-b7f6-4723-aacf-497a2fe53b5c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:42.604576 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-766e316f-b7f6-4723-aacf-497a2fe53b5c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:42.605006 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-766e316f-b7f6-4723-aacf-497a2fe53b5c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:42.733690 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-766e316f-b7f6-4723-aacf-497a2fe53b5c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:42.741731 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-766e316f-b7f6-4723-aacf-497a2fe53b5c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:42.743171 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-766e316f-b7f6-4723-aacf-497a2fe53b5c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:42.744320 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-766e316f-b7f6-4723-aacf-497a2fe53b5c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1721 microversion: 2.20 time: 0.152559 Aug 31 19:24:42.744867 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 517/1032] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:24:42 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:24:43.767666 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-66a4ddf7-2968-409c-816b-110939d4aee6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:43.768362 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-66a4ddf7-2968-409c-816b-110939d4aee6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:43.774841 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-66a4ddf7-2968-409c-816b-110939d4aee6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:43.775372 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-66a4ddf7-2968-409c-816b-110939d4aee6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:43.775797 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-66a4ddf7-2968-409c-816b-110939d4aee6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:43.776478 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-66a4ddf7-2968-409c-816b-110939d4aee6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:43.776918 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-66a4ddf7-2968-409c-816b-110939d4aee6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:43.777405 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-66a4ddf7-2968-409c-816b-110939d4aee6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:43.905678 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-66a4ddf7-2968-409c-816b-110939d4aee6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:43.913664 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-66a4ddf7-2968-409c-816b-110939d4aee6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:43.915120 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-66a4ddf7-2968-409c-816b-110939d4aee6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:43.916348 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-66a4ddf7-2968-409c-816b-110939d4aee6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1721 microversion: 2.20 time: 0.153582 Aug 31 19:24:43.916893 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 516/1033] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:24:43 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:24:44.939366 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e62f4ae3-f41a-4d79-b57e-2fe176dc6033 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:44.940046 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-e62f4ae3-f41a-4d79-b57e-2fe176dc6033 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:44.947400 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e62f4ae3-f41a-4d79-b57e-2fe176dc6033 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:44.947882 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e62f4ae3-f41a-4d79-b57e-2fe176dc6033 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:44.948316 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e62f4ae3-f41a-4d79-b57e-2fe176dc6033 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:44.950010 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e62f4ae3-f41a-4d79-b57e-2fe176dc6033 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:44.950010 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e62f4ae3-f41a-4d79-b57e-2fe176dc6033 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:44.950010 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e62f4ae3-f41a-4d79-b57e-2fe176dc6033 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:45.022077 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e62f4ae3-f41a-4d79-b57e-2fe176dc6033 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:45.030712 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e62f4ae3-f41a-4d79-b57e-2fe176dc6033 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:45.032168 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e62f4ae3-f41a-4d79-b57e-2fe176dc6033 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:45.033349 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-e62f4ae3-f41a-4d79-b57e-2fe176dc6033 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 200 len: 1654 microversion: 2.20 time: 0.098350 Aug 31 19:24:45.033908 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 518/1034] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:24:44 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 1654 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:24:45.268097 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-fdc273ea-d502-48f3-ab80-9238719188fb req-4a54e567-d17a-4cab-ae9b-fb2d2a0e44c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ff90966-a8dd-41ae-848d-e155bf217b05", "name": "network-vif-deleted", "tag": "54483789-2137-488f-8b8d-250e234b5c3c"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:24:45.279383 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-fdc273ea-d502-48f3-ab80-9238719188fb req-4a54e567-d17a-4cab-ae9b-fb2d2a0e44c6 service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:45.279859 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-fdc273ea-d502-48f3-ab80-9238719188fb req-4a54e567-d17a-4cab-ae9b-fb2d2a0e44c6 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:45.281560 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-fdc273ea-d502-48f3-ab80-9238719188fb req-4a54e567-d17a-4cab-ae9b-fb2d2a0e44c6 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:45.293798 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-fdc273ea-d502-48f3-ab80-9238719188fb req-4a54e567-d17a-4cab-ae9b-fb2d2a0e44c6 service nova] Creating event network-vif-deleted:54483789-2137-488f-8b8d-250e234b5c3c for instance 5ff90966-a8dd-41ae-848d-e155bf217b05 on hv-cinder-83538 Aug 31 19:24:45.300384 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-fdc273ea-d502-48f3-ab80-9238719188fb req-4a54e567-d17a-4cab-ae9b-fb2d2a0e44c6 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036845 Aug 31 19:24:45.301032 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 517/1035] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:24:46.055972 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-ab03c849-153d-4de8-9e3c-5cf1062fd617 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:46.056697 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-ab03c849-153d-4de8-9e3c-5cf1062fd617 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:46.064158 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ab03c849-153d-4de8-9e3c-5cf1062fd617 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:46.064651 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ab03c849-153d-4de8-9e3c-5cf1062fd617 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:46.065090 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ab03c849-153d-4de8-9e3c-5cf1062fd617 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:46.065851 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ab03c849-153d-4de8-9e3c-5cf1062fd617 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:46.066310 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ab03c849-153d-4de8-9e3c-5cf1062fd617 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:46.066735 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ab03c849-153d-4de8-9e3c-5cf1062fd617 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:46.082906 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.wsgi [None req-ab03c849-153d-4de8-9e3c-5cf1062fd617 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] HTTP exception thrown: Instance 5ff90966-a8dd-41ae-848d-e155bf217b05 could not be found. Aug 31 19:24:46.084596 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-ab03c849-153d-4de8-9e3c-5cf1062fd617 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Request method failure captured: Aug 31 19:24:46.084596 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: request: GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 HTTP/1.1 Aug 31 19:24:46.084596 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Accept: application/json Aug 31 19:24:46.084596 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Accept-Encoding: identity Aug 31 19:24:46.084596 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Connection: close Aug 31 19:24:46.084596 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Content-Length: 0 Aug 31 19:24:46.084596 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Content-Type: application/json Aug 31 19:24:46.084596 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Host: 10.222.0.65 Aug 31 19:24:46.084596 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Openstack-System-Scope: None Aug 31 19:24:46.084596 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: User-Agent: python-urllib3/1.26.12 Aug 31 19:24:46.084596 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Auth-Token: gAAAAABjD7Slys0jkCkYRjhjxYgl805D58cApuFIYgk0tH0ut16LlbqCdxfGzIsbVdrGbQ_6zex4s54Z8wA9Ui-YVaZKnICUdH-MmvMh271YRMSBcfnxPw92D1VoLrvRA4y8QryNRfLfv7T9M8PgvLCNErvNzS1YxgemAjvnmIl-IF2f5EQwrxI Aug 31 19:24:46.084596 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Domain-Id: None Aug 31 19:24:46.084596 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Domain-Name: None Aug 31 19:24:46.084596 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Identity-Status: Confirmed Aug 31 19:24:46.084596 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Is-Admin-Project: True Aug 31 19:24:46.084596 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 19:24:46.084596 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Id: default Aug 31 19:24:46.084596 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Name: Default Aug 31 19:24:46.084596 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Id: 12835bbc76594286925e297e824e0d91 Aug 31 19:24:46.084596 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-64175436 Aug 31 19:24:46.084596 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Role: member,reader Aug 31 19:24:46.084596 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Roles: member,reader Aug 31 19:24:46.086402 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/12835bbc76594286925e297e824e0d91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/12835bbc76594286925e297e824e0d91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_12835bbc76594286925e297e824e0d91", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/12835bbc76594286925e297e824e0d91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:24:46.086402 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant: tempest-AttachVolumeShelveTestJSON-64175436 Aug 31 19:24:46.086402 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant-Id: 12835bbc76594286925e297e824e0d91 Aug 31 19:24:46.086402 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-64175436 Aug 31 19:24:46.086402 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User: tempest-AttachVolumeShelveTestJSON-64175436-project Aug 31 19:24:46.086402 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Id: default Aug 31 19:24:46.086402 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Name: Default Aug 31 19:24:46.086402 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Id: 347993dd122543a684681c1a0783962c Aug 31 19:24:46.086402 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Name: tempest-AttachVolumeShelveTestJSON-64175436-project Aug 31 19:24:46.086402 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: method: > Aug 31 19:24:46.086402 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: exception: Instance 5ff90966-a8dd-41ae-848d-e155bf217b05 could not be found. Aug 31 19:24:46.086402 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: action_args: {'id': '5ff90966-a8dd-41ae-848d-e155bf217b05'} Aug 31 19:24:46.087461 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:24:46.087461 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:24:46.087461 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:24:46.087461 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:24:46.087461 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:24:46.087461 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:24:46.087461 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:24:46.087461 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:24:46.087461 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:24:46.087461 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:24:46.087461 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ff90966-a8dd-41ae-848d-e155bf217b05 could not be found. Aug 31 19:24:46.087461 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:24:46.087461 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:24:46.087461 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:24:46.087461 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:24:46.087461 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:24:46.087461 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:24:46.087461 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:24:46.087461 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:24:46.087461 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:24:46.089104 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:24:46.089104 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:24:46.089104 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:24:46.089104 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:24:46.089104 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:24:46.089104 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:24:46.089104 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:24:46.089104 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ff90966-a8dd-41ae-848d-e155bf217b05 could not be found. Aug 31 19:24:46.089104 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:24:46.089104 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:24:46.089104 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:24:46.089104 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:24:46.089104 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:24:46.089104 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:24:46.089104 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:24:46.089104 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:24:46.089104 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ff90966-a8dd-41ae-848d-e155bf217b05 could not be found. Aug 31 19:24:46.089104 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:24:46.091080 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-ab03c849-153d-4de8-9e3c-5cf1062fd617 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Returning 404 to user: Instance 5ff90966-a8dd-41ae-848d-e155bf217b05 could not be found. {{(pid=120623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:24:46.091080 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-ab03c849-153d-4de8-9e3c-5cf1062fd617 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 404 len: 111 microversion: 2.20 time: 0.033950 Aug 31 19:24:46.091080 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 519/1036] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:24:46 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 19:24:46.096994 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-c0471237-3014-4a32-ace9-fc62ea7e2574 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '.version_select at 0x7fdb89bfe310>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:46.122101 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-c0471237-3014-4a32-ace9-fc62ea7e2574 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-440729922" status: 204 len: 0 microversion: 2.20 time: 0.029759 Aug 31 19:24:46.122710 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 518/1037] 10.222.0.65 () {60 vars in 1259 bytes} [Wed Aug 31 19:24:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-440729922 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 19:24:46.744034 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-796d545e-f1e9-4902-b7c6-ff58de1ea78b tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Action: 'create', calling method: .version_select at 0x7fdb86578c10>, body: {"keypair": {"name": "tempest-keypair-795984166", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBABK24/1qZRzmYF28F1aw0aw0tbo7VbryXq+iyptDUcxkjEjQLDmZWEA/4+tRrW3tN2laX0DPRaLSTqHk9i27QFbGumM7n+gwXXzemlB88pbalZCAt3BbZRiordqmnYgbA=="}} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:24:46.759166 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.quota [None req-796d545e-f1e9-4902-b7c6-ff58de1ea78b tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Getting quotas for project 12835bbc76594286925e297e824e0d91. Resources: {'key_pairs'} {{(pid=120623) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:24:46.763006 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.quota [None req-796d545e-f1e9-4902-b7c6-ff58de1ea78b tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Getting quotas for user 347993dd122543a684681c1a0783962c and project 12835bbc76594286925e297e824e0d91. Resources: {'key_pairs'} {{(pid=120623) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:24:46.784711 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-796d545e-f1e9-4902-b7c6-ff58de1ea78b tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.044783 Aug 31 19:24:46.785703 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 520/1038] 10.222.0.65 () {62 vars in 1200 bytes} [Wed Aug 31 19:24:46 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 46 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 31 19:24:48.039703 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-16b37c11-8c33-4d94-bf1d-14a32afd2bc1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-154486308", "imageRef": "f4f2ae76-bacc-4449-881b-f697e1eeec66", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e915fb38-87df-41d0-8876-236bab429f04"}], "security_groups": [{"name": "tempest-securitygroup--2065406997"}], "key_name": "tempest-keypair-795984166", "user_data": "}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:24:48.141808 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.network.neutron [None req-16b37c11-8c33-4d94-bf1d-14a32afd2bc1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] validate_networks() for [('e915fb38-87df-41d0-8876-236bab429f04', None, None, None, None, None)] {{(pid=120624) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:24:48.765536 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-16b37c11-8c33-4d94-bf1d-14a32afd2bc1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Flavor limits 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:24:48.766158 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-16b37c11-8c33-4d94-bf1d-14a32afd2bc1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Image limits 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:24:48.766632 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-16b37c11-8c33-4d94-bf1d-14a32afd2bc1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Flavor pref 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:24:48.767038 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-16b37c11-8c33-4d94-bf1d-14a32afd2bc1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Image pref 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:24:48.767447 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-16b37c11-8c33-4d94-bf1d-14a32afd2bc1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:24:48.776080 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-16b37c11-8c33-4d94-bf1d-14a32afd2bc1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:48.776553 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-16b37c11-8c33-4d94-bf1d-14a32afd2bc1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:48.776977 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-16b37c11-8c33-4d94-bf1d-14a32afd2bc1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:48.777738 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-16b37c11-8c33-4d94-bf1d-14a32afd2bc1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:48.778185 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-16b37c11-8c33-4d94-bf1d-14a32afd2bc1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:48.778602 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-16b37c11-8c33-4d94-bf1d-14a32afd2bc1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:48.795637 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-16b37c11-8c33-4d94-bf1d-14a32afd2bc1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Getting quotas for project 12835bbc76594286925e297e824e0d91. Resources: {'instances', 'cores', 'ram'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:24:48.799628 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-16b37c11-8c33-4d94-bf1d-14a32afd2bc1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Getting quotas for user 347993dd122543a684681c1a0783962c and project 12835bbc76594286925e297e824e0d91. Resources: {'instances', 'cores', 'ram'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:24:48.810293 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-16b37c11-8c33-4d94-bf1d-14a32afd2bc1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Going to run 1 instances... {{(pid=120624) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:24:48.812915 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-16b37c11-8c33-4d94-bf1d-14a32afd2bc1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f4f2ae76-bacc-4449-881b-f697e1eeec66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120624) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:24:48.867641 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-16b37c11-8c33-4d94-bf1d-14a32afd2bc1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.832736 Aug 31 19:24:48.868573 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 519/1039] 10.222.0.65 () {62 vars in 1188 bytes} [Wed Aug 31 19:24:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 834 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 31 19:24:48.879917 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-10aad5b6-adf7-43fd-9df8-77ea09d1f444 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:48.880616 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-10aad5b6-adf7-43fd-9df8-77ea09d1f444 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:48.934347 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-10aad5b6-adf7-43fd-9df8-77ea09d1f444 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:48.941593 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-10aad5b6-adf7-43fd-9df8-77ea09d1f444 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:48.943020 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-10aad5b6-adf7-43fd-9df8-77ea09d1f444 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:48.944315 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-10aad5b6-adf7-43fd-9df8-77ea09d1f444 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1280 microversion: 2.20 time: 0.068774 Aug 31 19:24:48.944867 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 521/1040] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:24:48 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1280 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:24:49.966635 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-e9087e78-7526-4087-aa0d-d5206bd666c2 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:49.967376 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-e9087e78-7526-4087-aa0d-d5206bd666c2 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:49.974984 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e9087e78-7526-4087-aa0d-d5206bd666c2 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:49.975482 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e9087e78-7526-4087-aa0d-d5206bd666c2 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:49.976352 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e9087e78-7526-4087-aa0d-d5206bd666c2 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:49.976616 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e9087e78-7526-4087-aa0d-d5206bd666c2 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:49.977065 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e9087e78-7526-4087-aa0d-d5206bd666c2 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:49.977685 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e9087e78-7526-4087-aa0d-d5206bd666c2 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:50.055014 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-e9087e78-7526-4087-aa0d-d5206bd666c2 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:50.063731 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-e9087e78-7526-4087-aa0d-d5206bd666c2 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:50.065152 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-e9087e78-7526-4087-aa0d-d5206bd666c2 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:50.066613 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-e9087e78-7526-4087-aa0d-d5206bd666c2 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1350 microversion: 2.20 time: 0.103684 Aug 31 19:24:50.066845 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 520/1041] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:24:49 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1350 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:24:51.089730 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-3f8613f2-5588-4359-a820-6a9650bcb539 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:51.090574 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-3f8613f2-5588-4359-a820-6a9650bcb539 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:51.097424 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3f8613f2-5588-4359-a820-6a9650bcb539 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:51.097927 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3f8613f2-5588-4359-a820-6a9650bcb539 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:51.098378 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3f8613f2-5588-4359-a820-6a9650bcb539 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:51.099274 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3f8613f2-5588-4359-a820-6a9650bcb539 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:51.099733 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3f8613f2-5588-4359-a820-6a9650bcb539 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:51.100163 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3f8613f2-5588-4359-a820-6a9650bcb539 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:51.235708 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-3f8613f2-5588-4359-a820-6a9650bcb539 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:51.244737 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-3f8613f2-5588-4359-a820-6a9650bcb539 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:51.246303 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-3f8613f2-5588-4359-a820-6a9650bcb539 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:51.247734 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-3f8613f2-5588-4359-a820-6a9650bcb539 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1406 microversion: 2.20 time: 0.162390 Aug 31 19:24:51.248295 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 522/1042] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:24:51 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:24:51.308422 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-ca0980e4-965f-4c96-bd32-75567476e84c req-eafade8f-cde0-42fb-a416-d50d122030e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb51cb62-2a6e-493d-94b7-48486f626d56", "tag": "9e4f721b-2045-49c9-a2a8-2ed988b63507"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:24:51.323322 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-ca0980e4-965f-4c96-bd32-75567476e84c req-eafade8f-cde0-42fb-a416-d50d122030e4 service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:51.323728 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-ca0980e4-965f-4c96-bd32-75567476e84c req-eafade8f-cde0-42fb-a416-d50d122030e4 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:51.324150 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-ca0980e4-965f-4c96-bd32-75567476e84c req-eafade8f-cde0-42fb-a416-d50d122030e4 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:51.335868 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-ca0980e4-965f-4c96-bd32-75567476e84c req-eafade8f-cde0-42fb-a416-d50d122030e4 service nova] Creating event network-changed:9e4f721b-2045-49c9-a2a8-2ed988b63507 for instance eb51cb62-2a6e-493d-94b7-48486f626d56 on hv-cinder-83538 Aug 31 19:24:51.340701 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-ca0980e4-965f-4c96-bd32-75567476e84c req-eafade8f-cde0-42fb-a416-d50d122030e4 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036783 Aug 31 19:24:51.341332 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 521/1043] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:24:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:24:52.270863 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e684e959-8789-468d-b9ee-ff3f6b0b4619 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:52.271460 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-e684e959-8789-468d-b9ee-ff3f6b0b4619 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:52.277470 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e684e959-8789-468d-b9ee-ff3f6b0b4619 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:52.277941 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e684e959-8789-468d-b9ee-ff3f6b0b4619 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:52.278364 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e684e959-8789-468d-b9ee-ff3f6b0b4619 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:52.279038 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e684e959-8789-468d-b9ee-ff3f6b0b4619 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:52.279480 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e684e959-8789-468d-b9ee-ff3f6b0b4619 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:52.279905 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e684e959-8789-468d-b9ee-ff3f6b0b4619 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:52.406480 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e684e959-8789-468d-b9ee-ff3f6b0b4619 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:52.414367 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e684e959-8789-468d-b9ee-ff3f6b0b4619 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:52.415834 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e684e959-8789-468d-b9ee-ff3f6b0b4619 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:52.416918 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-e684e959-8789-468d-b9ee-ff3f6b0b4619 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1406 microversion: 2.20 time: 0.150122 Aug 31 19:24:52.417489 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 523/1044] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:24:52 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:24:53.439486 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-f17f2be9-74ea-4dfd-83a1-cccb6c8f9cea tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:53.440170 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-f17f2be9-74ea-4dfd-83a1-cccb6c8f9cea tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:53.446259 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f17f2be9-74ea-4dfd-83a1-cccb6c8f9cea tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:53.446784 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f17f2be9-74ea-4dfd-83a1-cccb6c8f9cea tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:53.447152 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f17f2be9-74ea-4dfd-83a1-cccb6c8f9cea tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:53.447821 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f17f2be9-74ea-4dfd-83a1-cccb6c8f9cea tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:53.448261 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f17f2be9-74ea-4dfd-83a1-cccb6c8f9cea tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:53.448669 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f17f2be9-74ea-4dfd-83a1-cccb6c8f9cea tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:53.580614 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-f17f2be9-74ea-4dfd-83a1-cccb6c8f9cea tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:53.588598 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-f17f2be9-74ea-4dfd-83a1-cccb6c8f9cea tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:53.590060 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-f17f2be9-74ea-4dfd-83a1-cccb6c8f9cea tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:53.591146 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-f17f2be9-74ea-4dfd-83a1-cccb6c8f9cea tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1406 microversion: 2.20 time: 0.156462 Aug 31 19:24:53.591701 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 522/1045] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:24:53 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:24:54.613125 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-8b359dad-6501-4556-b4de-9e16b58aa6d0 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:54.613822 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-8b359dad-6501-4556-b4de-9e16b58aa6d0 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:54.620127 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8b359dad-6501-4556-b4de-9e16b58aa6d0 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:54.620630 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8b359dad-6501-4556-b4de-9e16b58aa6d0 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:54.621053 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8b359dad-6501-4556-b4de-9e16b58aa6d0 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:54.621777 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8b359dad-6501-4556-b4de-9e16b58aa6d0 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:54.622233 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8b359dad-6501-4556-b4de-9e16b58aa6d0 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:54.622656 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8b359dad-6501-4556-b4de-9e16b58aa6d0 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:54.752345 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-8b359dad-6501-4556-b4de-9e16b58aa6d0 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:54.760492 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-8b359dad-6501-4556-b4de-9e16b58aa6d0 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:54.761970 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-8b359dad-6501-4556-b4de-9e16b58aa6d0 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:54.763069 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-8b359dad-6501-4556-b4de-9e16b58aa6d0 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1406 microversion: 2.20 time: 0.153900 Aug 31 19:24:54.763627 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 524/1046] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:24:54 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:24:55.784868 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-4f92d1bb-42ce-4ed0-ba03-468acdee1bbf tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:55.785506 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-4f92d1bb-42ce-4ed0-ba03-468acdee1bbf tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:55.791995 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4f92d1bb-42ce-4ed0-ba03-468acdee1bbf tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:55.792469 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4f92d1bb-42ce-4ed0-ba03-468acdee1bbf tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:55.792891 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4f92d1bb-42ce-4ed0-ba03-468acdee1bbf tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:55.793601 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4f92d1bb-42ce-4ed0-ba03-468acdee1bbf tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:55.794043 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4f92d1bb-42ce-4ed0-ba03-468acdee1bbf tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:55.794459 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4f92d1bb-42ce-4ed0-ba03-468acdee1bbf tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:55.924618 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-4f92d1bb-42ce-4ed0-ba03-468acdee1bbf tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:55.932580 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-4f92d1bb-42ce-4ed0-ba03-468acdee1bbf tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:55.934028 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-4f92d1bb-42ce-4ed0-ba03-468acdee1bbf tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:55.935120 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-4f92d1bb-42ce-4ed0-ba03-468acdee1bbf tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1406 microversion: 2.20 time: 0.154163 Aug 31 19:24:55.935670 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 523/1047] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:24:55 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:24:56.956713 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-f1aef347-3549-4647-848d-9e93952fc8f6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:56.957385 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-f1aef347-3549-4647-848d-9e93952fc8f6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:56.963865 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f1aef347-3549-4647-848d-9e93952fc8f6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:56.964350 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f1aef347-3549-4647-848d-9e93952fc8f6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:56.964786 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f1aef347-3549-4647-848d-9e93952fc8f6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:56.965504 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f1aef347-3549-4647-848d-9e93952fc8f6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:56.965961 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f1aef347-3549-4647-848d-9e93952fc8f6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:56.966388 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f1aef347-3549-4647-848d-9e93952fc8f6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:57.093315 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-f1aef347-3549-4647-848d-9e93952fc8f6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:57.103423 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-f1aef347-3549-4647-848d-9e93952fc8f6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:57.104869 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-f1aef347-3549-4647-848d-9e93952fc8f6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:57.106014 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-f1aef347-3549-4647-848d-9e93952fc8f6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1406 microversion: 2.20 time: 0.153190 Aug 31 19:24:57.106567 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 525/1048] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:24:56 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:24:58.001065 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-b8081f0f-d3cc-4b7a-afdd-84f5f77b36ad req-f9b525c0-0a07-43c5-9a19-2e5501057474 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb51cb62-2a6e-493d-94b7-48486f626d56", "name": "network-vif-plugged", "status": "completed", "tag": "9e4f721b-2045-49c9-a2a8-2ed988b63507"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:24:58.011808 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-b8081f0f-d3cc-4b7a-afdd-84f5f77b36ad req-f9b525c0-0a07-43c5-9a19-2e5501057474 service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:58.012293 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-b8081f0f-d3cc-4b7a-afdd-84f5f77b36ad req-f9b525c0-0a07-43c5-9a19-2e5501057474 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:58.012721 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-b8081f0f-d3cc-4b7a-afdd-84f5f77b36ad req-f9b525c0-0a07-43c5-9a19-2e5501057474 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:58.023954 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-b8081f0f-d3cc-4b7a-afdd-84f5f77b36ad req-f9b525c0-0a07-43c5-9a19-2e5501057474 service nova] Creating event network-vif-plugged:9e4f721b-2045-49c9-a2a8-2ed988b63507 for instance eb51cb62-2a6e-493d-94b7-48486f626d56 on hv-cinder-83538 Aug 31 19:24:58.028995 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-b8081f0f-d3cc-4b7a-afdd-84f5f77b36ad req-f9b525c0-0a07-43c5-9a19-2e5501057474 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031652 Aug 31 19:24:58.030320 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 524/1049] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:24:58.128506 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-a9ef443a-31d8-44b4-98b6-ced876d75912 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:58.129064 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-a9ef443a-31d8-44b4-98b6-ced876d75912 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:58.135382 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a9ef443a-31d8-44b4-98b6-ced876d75912 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:58.135875 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a9ef443a-31d8-44b4-98b6-ced876d75912 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:58.136314 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a9ef443a-31d8-44b4-98b6-ced876d75912 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:58.137026 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a9ef443a-31d8-44b4-98b6-ced876d75912 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:58.137504 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a9ef443a-31d8-44b4-98b6-ced876d75912 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:58.137932 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a9ef443a-31d8-44b4-98b6-ced876d75912 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:58.273695 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-a9ef443a-31d8-44b4-98b6-ced876d75912 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:58.282684 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-a9ef443a-31d8-44b4-98b6-ced876d75912 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:58.284136 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-a9ef443a-31d8-44b4-98b6-ced876d75912 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:58.285309 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-a9ef443a-31d8-44b4-98b6-ced876d75912 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1406 microversion: 2.20 time: 0.161213 Aug 31 19:24:58.285864 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 526/1050] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:24:58 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:24:59.305447 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell0:SELECT=2 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:59.306224 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell0:SELECT=6 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:59.310859 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-01385f13-dc85-448a-8f7a-2a96e2cdf652 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:59.312149 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-01385f13-dc85-448a-8f7a-2a96e2cdf652 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:59.319029 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-01385f13-dc85-448a-8f7a-2a96e2cdf652 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:59.319504 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-01385f13-dc85-448a-8f7a-2a96e2cdf652 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:59.319928 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-01385f13-dc85-448a-8f7a-2a96e2cdf652 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:59.320594 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-01385f13-dc85-448a-8f7a-2a96e2cdf652 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:59.321034 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-01385f13-dc85-448a-8f7a-2a96e2cdf652 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:59.321469 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-01385f13-dc85-448a-8f7a-2a96e2cdf652 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:59.451755 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-01385f13-dc85-448a-8f7a-2a96e2cdf652 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:59.459665 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-01385f13-dc85-448a-8f7a-2a96e2cdf652 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:59.461136 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-01385f13-dc85-448a-8f7a-2a96e2cdf652 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:59.462273 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-01385f13-dc85-448a-8f7a-2a96e2cdf652 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1406 microversion: 2.20 time: 0.157844 Aug 31 19:24:59.462816 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 525/1051] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:24:59 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:25:00.484896 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-a86089ec-461c-432b-a26c-c788eebaadfa tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:00.485481 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-a86089ec-461c-432b-a26c-c788eebaadfa tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:00.487986 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell0:SELECT=6 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:00.493953 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a86089ec-461c-432b-a26c-c788eebaadfa tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:00.494431 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a86089ec-461c-432b-a26c-c788eebaadfa tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:00.494854 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a86089ec-461c-432b-a26c-c788eebaadfa tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:00.495533 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a86089ec-461c-432b-a26c-c788eebaadfa tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:00.495976 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a86089ec-461c-432b-a26c-c788eebaadfa tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:00.496389 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a86089ec-461c-432b-a26c-c788eebaadfa tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:00.629155 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-a86089ec-461c-432b-a26c-c788eebaadfa tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:00.637161 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-a86089ec-461c-432b-a26c-c788eebaadfa tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:00.638623 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-a86089ec-461c-432b-a26c-c788eebaadfa tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:00.640321 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-a86089ec-461c-432b-a26c-c788eebaadfa tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1598 microversion: 2.20 time: 0.159480 Aug 31 19:25:00.640877 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 527/1052] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:25:00 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1598 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:25:00.662385 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-a3249d04-c7ad-47c2-952d-80a7176bfd44 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:00.662877 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-a3249d04-c7ad-47c2-952d-80a7176bfd44 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:00.669234 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a3249d04-c7ad-47c2-952d-80a7176bfd44 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:00.669717 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a3249d04-c7ad-47c2-952d-80a7176bfd44 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:00.670145 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a3249d04-c7ad-47c2-952d-80a7176bfd44 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:00.670830 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a3249d04-c7ad-47c2-952d-80a7176bfd44 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:00.671277 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a3249d04-c7ad-47c2-952d-80a7176bfd44 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:00.671694 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a3249d04-c7ad-47c2-952d-80a7176bfd44 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:00.747351 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-a3249d04-c7ad-47c2-952d-80a7176bfd44 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.088774 Aug 31 19:25:00.747941 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 526/1053] 10.222.0.65 () {60 vars in 1316 bytes} [Wed Aug 31 19:25:00 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 19:25:01.686500 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-e05c6028-1642-4748-a141-6b950a92d39b req-2207aa89-2b40-458b-a21c-4665f91c723d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb51cb62-2a6e-493d-94b7-48486f626d56", "tag": "9e4f721b-2045-49c9-a2a8-2ed988b63507"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:25:01.696436 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-e05c6028-1642-4748-a141-6b950a92d39b req-2207aa89-2b40-458b-a21c-4665f91c723d service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:01.696985 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-e05c6028-1642-4748-a141-6b950a92d39b req-2207aa89-2b40-458b-a21c-4665f91c723d service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:01.697579 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-e05c6028-1642-4748-a141-6b950a92d39b req-2207aa89-2b40-458b-a21c-4665f91c723d service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:01.708874 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-e05c6028-1642-4748-a141-6b950a92d39b req-2207aa89-2b40-458b-a21c-4665f91c723d service nova] Creating event network-changed:9e4f721b-2045-49c9-a2a8-2ed988b63507 for instance eb51cb62-2a6e-493d-94b7-48486f626d56 on hv-cinder-83538 Aug 31 19:25:01.714036 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-e05c6028-1642-4748-a141-6b950a92d39b req-2207aa89-2b40-458b-a21c-4665f91c723d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031237 Aug 31 19:25:01.714631 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 528/1054] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:26:16.704873 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:16.705638 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:16.823606 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-1a5c86e6-4ada-4aa9-ab76-dc2d2162280f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:16.824095 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-1a5c86e6-4ada-4aa9-ab76-dc2d2162280f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:16.830131 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1a5c86e6-4ada-4aa9-ab76-dc2d2162280f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:16.830610 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1a5c86e6-4ada-4aa9-ab76-dc2d2162280f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:16.831041 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1a5c86e6-4ada-4aa9-ab76-dc2d2162280f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:16.832463 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1a5c86e6-4ada-4aa9-ab76-dc2d2162280f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:16.832928 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1a5c86e6-4ada-4aa9-ab76-dc2d2162280f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:16.833387 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1a5c86e6-4ada-4aa9-ab76-dc2d2162280f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:16.856453 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-1a5c86e6-4ada-4aa9-ab76-dc2d2162280f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56/ips" status: 200 len: 151 microversion: 2.20 time: 0.153487 Aug 31 19:26:16.856995 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 527/1055] 10.222.0.65 () {60 vars in 1289 bytes} [Wed Aug 31 19:26:16 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56/ips => generated 151 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 19:26:18.613514 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:18.614253 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=67,nova_cell1:INSERT=1 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:18.619356 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-073898bb-a29e-4bd3-a855-3c9a37761c39 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:26:18.619970 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-073898bb-a29e-4bd3-a855-3c9a37761c39 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:18.628415 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-073898bb-a29e-4bd3-a855-3c9a37761c39 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:18.628888 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-073898bb-a29e-4bd3-a855-3c9a37761c39 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:18.629341 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-073898bb-a29e-4bd3-a855-3c9a37761c39 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:18.630019 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-073898bb-a29e-4bd3-a855-3c9a37761c39 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:18.630464 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-073898bb-a29e-4bd3-a855-3c9a37761c39 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:18.630879 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-073898bb-a29e-4bd3-a855-3c9a37761c39 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:18.653380 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.objects.instance [None req-073898bb-a29e-4bd3-a855-3c9a37761c39 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lazy-loading 'flavor' on Instance uuid eb51cb62-2a6e-493d-94b7-48486f626d56 {{(pid=120623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:26:18.828601 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-073898bb-a29e-4bd3-a855-3c9a37761c39 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "POST /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56/action" status: 202 len: 0 microversion: 2.20 time: 0.217668 Aug 31 19:26:18.829244 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 529/1056] 10.222.0.65 () {62 vars in 1319 bytes} [Wed Aug 31 19:26:18 2022] POST /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:26:18.837374 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-3ade61d0-3433-4b03-9eae-50a28c7fda76 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:18.837991 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-3ade61d0-3433-4b03-9eae-50a28c7fda76 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:18.844630 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3ade61d0-3433-4b03-9eae-50a28c7fda76 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:18.845118 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3ade61d0-3433-4b03-9eae-50a28c7fda76 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:18.845602 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3ade61d0-3433-4b03-9eae-50a28c7fda76 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:18.846384 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3ade61d0-3433-4b03-9eae-50a28c7fda76 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:18.846886 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3ade61d0-3433-4b03-9eae-50a28c7fda76 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:18.847809 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3ade61d0-3433-4b03-9eae-50a28c7fda76 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:18.984068 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-3ade61d0-3433-4b03-9eae-50a28c7fda76 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:18.992147 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-3ade61d0-3433-4b03-9eae-50a28c7fda76 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:18.993639 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-3ade61d0-3433-4b03-9eae-50a28c7fda76 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:18.994836 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-3ade61d0-3433-4b03-9eae-50a28c7fda76 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1722 microversion: 2.20 time: 0.161376 Aug 31 19:26:18.995421 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 528/1057] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:18 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:20.018262 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-647119df-e89b-449d-9bde-6b132c1f202e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:20.018949 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-647119df-e89b-449d-9bde-6b132c1f202e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:20.025926 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-647119df-e89b-449d-9bde-6b132c1f202e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:20.026403 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-647119df-e89b-449d-9bde-6b132c1f202e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:20.026831 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-647119df-e89b-449d-9bde-6b132c1f202e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:20.027506 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-647119df-e89b-449d-9bde-6b132c1f202e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:20.027950 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-647119df-e89b-449d-9bde-6b132c1f202e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:20.028366 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-647119df-e89b-449d-9bde-6b132c1f202e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:20.154823 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-647119df-e89b-449d-9bde-6b132c1f202e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:20.163294 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-647119df-e89b-449d-9bde-6b132c1f202e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:20.164748 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-647119df-e89b-449d-9bde-6b132c1f202e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:20.165945 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-647119df-e89b-449d-9bde-6b132c1f202e tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1722 microversion: 2.20 time: 0.152428 Aug 31 19:26:20.166490 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 530/1058] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:20 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:21.187958 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-fd2b1d69-09d1-4a8a-8526-4e71885001c8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:21.188481 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-fd2b1d69-09d1-4a8a-8526-4e71885001c8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:21.195792 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fd2b1d69-09d1-4a8a-8526-4e71885001c8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:21.196272 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fd2b1d69-09d1-4a8a-8526-4e71885001c8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:21.196701 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fd2b1d69-09d1-4a8a-8526-4e71885001c8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:21.197419 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fd2b1d69-09d1-4a8a-8526-4e71885001c8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:21.197867 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fd2b1d69-09d1-4a8a-8526-4e71885001c8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:21.198282 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fd2b1d69-09d1-4a8a-8526-4e71885001c8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:21.328611 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-fd2b1d69-09d1-4a8a-8526-4e71885001c8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:21.337246 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-fd2b1d69-09d1-4a8a-8526-4e71885001c8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:21.338689 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-fd2b1d69-09d1-4a8a-8526-4e71885001c8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:21.339848 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-fd2b1d69-09d1-4a8a-8526-4e71885001c8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1722 microversion: 2.20 time: 0.155889 Aug 31 19:26:21.340397 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 529/1059] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:21 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:22.364583 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-8d96cf52-3901-485c-a7ec-ef12ae4ba75c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:22.365215 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-8d96cf52-3901-485c-a7ec-ef12ae4ba75c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:22.372110 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8d96cf52-3901-485c-a7ec-ef12ae4ba75c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:22.372593 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8d96cf52-3901-485c-a7ec-ef12ae4ba75c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:22.373028 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8d96cf52-3901-485c-a7ec-ef12ae4ba75c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:22.373757 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8d96cf52-3901-485c-a7ec-ef12ae4ba75c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:22.374215 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8d96cf52-3901-485c-a7ec-ef12ae4ba75c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:22.374641 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8d96cf52-3901-485c-a7ec-ef12ae4ba75c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:22.507660 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-8d96cf52-3901-485c-a7ec-ef12ae4ba75c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:22.515636 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-8d96cf52-3901-485c-a7ec-ef12ae4ba75c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:22.517110 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-8d96cf52-3901-485c-a7ec-ef12ae4ba75c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:22.518298 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-8d96cf52-3901-485c-a7ec-ef12ae4ba75c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1722 microversion: 2.20 time: 0.158478 Aug 31 19:26:22.518856 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 531/1060] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:22 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:23.549647 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-9a283d97-05fb-4733-9974-efb111188c26 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:23.550253 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-9a283d97-05fb-4733-9974-efb111188c26 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:23.557118 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9a283d97-05fb-4733-9974-efb111188c26 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:23.557632 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9a283d97-05fb-4733-9974-efb111188c26 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:23.558063 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9a283d97-05fb-4733-9974-efb111188c26 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:23.558742 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9a283d97-05fb-4733-9974-efb111188c26 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:23.559192 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9a283d97-05fb-4733-9974-efb111188c26 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:23.559609 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9a283d97-05fb-4733-9974-efb111188c26 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:23.686509 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-9a283d97-05fb-4733-9974-efb111188c26 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:23.694635 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-9a283d97-05fb-4733-9974-efb111188c26 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:23.696096 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-9a283d97-05fb-4733-9974-efb111188c26 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:23.697267 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-9a283d97-05fb-4733-9974-efb111188c26 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1722 microversion: 2.20 time: 0.151537 Aug 31 19:26:23.697816 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 530/1061] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:23 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:24.719102 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-77285d87-7801-471b-b90d-d74f742d62f1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:24.719992 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-77285d87-7801-471b-b90d-d74f742d62f1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:24.726391 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-77285d87-7801-471b-b90d-d74f742d62f1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:24.726876 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-77285d87-7801-471b-b90d-d74f742d62f1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:24.727309 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-77285d87-7801-471b-b90d-d74f742d62f1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:24.728017 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-77285d87-7801-471b-b90d-d74f742d62f1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:24.728450 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-77285d87-7801-471b-b90d-d74f742d62f1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:24.728873 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-77285d87-7801-471b-b90d-d74f742d62f1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:24.856492 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-77285d87-7801-471b-b90d-d74f742d62f1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:24.864658 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-77285d87-7801-471b-b90d-d74f742d62f1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:24.866630 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-77285d87-7801-471b-b90d-d74f742d62f1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:24.867788 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-77285d87-7801-471b-b90d-d74f742d62f1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1722 microversion: 2.20 time: 0.152621 Aug 31 19:26:24.868342 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 532/1062] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:24 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:25.890915 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-1f6513a8-f751-42f0-b2a4-1099b1a8b6ae tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:25.891499 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-1f6513a8-f751-42f0-b2a4-1099b1a8b6ae tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:25.898435 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1f6513a8-f751-42f0-b2a4-1099b1a8b6ae tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:25.898902 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1f6513a8-f751-42f0-b2a4-1099b1a8b6ae tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:25.899323 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1f6513a8-f751-42f0-b2a4-1099b1a8b6ae tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:25.900002 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1f6513a8-f751-42f0-b2a4-1099b1a8b6ae tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:25.900444 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1f6513a8-f751-42f0-b2a4-1099b1a8b6ae tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:25.900857 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1f6513a8-f751-42f0-b2a4-1099b1a8b6ae tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:26.030745 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-1f6513a8-f751-42f0-b2a4-1099b1a8b6ae tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:26.038817 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-1f6513a8-f751-42f0-b2a4-1099b1a8b6ae tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:26.040241 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-1f6513a8-f751-42f0-b2a4-1099b1a8b6ae tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:26.041410 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-1f6513a8-f751-42f0-b2a4-1099b1a8b6ae tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1722 microversion: 2.20 time: 0.154401 Aug 31 19:26:26.041961 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 531/1063] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:25 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:27.064096 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-b9df51f2-a9ff-4430-8ac8-af9050212f21 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:27.064617 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-b9df51f2-a9ff-4430-8ac8-af9050212f21 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:27.071017 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b9df51f2-a9ff-4430-8ac8-af9050212f21 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:27.071494 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b9df51f2-a9ff-4430-8ac8-af9050212f21 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:27.071922 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b9df51f2-a9ff-4430-8ac8-af9050212f21 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:27.072596 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b9df51f2-a9ff-4430-8ac8-af9050212f21 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:27.073040 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b9df51f2-a9ff-4430-8ac8-af9050212f21 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:27.073554 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b9df51f2-a9ff-4430-8ac8-af9050212f21 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:27.203580 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-b9df51f2-a9ff-4430-8ac8-af9050212f21 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:27.212267 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-b9df51f2-a9ff-4430-8ac8-af9050212f21 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:27.213728 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-b9df51f2-a9ff-4430-8ac8-af9050212f21 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:27.214873 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-b9df51f2-a9ff-4430-8ac8-af9050212f21 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1722 microversion: 2.20 time: 0.154795 Aug 31 19:26:27.215426 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 533/1064] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:27 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:28.238003 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-121e0109-945b-4407-8d7e-efe7f883b415 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:28.238749 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-121e0109-945b-4407-8d7e-efe7f883b415 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:28.245886 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-121e0109-945b-4407-8d7e-efe7f883b415 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:28.246365 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-121e0109-945b-4407-8d7e-efe7f883b415 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:28.246791 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-121e0109-945b-4407-8d7e-efe7f883b415 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:28.247479 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-121e0109-945b-4407-8d7e-efe7f883b415 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:28.247927 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-121e0109-945b-4407-8d7e-efe7f883b415 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:28.248346 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-121e0109-945b-4407-8d7e-efe7f883b415 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:28.455747 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-121e0109-945b-4407-8d7e-efe7f883b415 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:28.464388 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-121e0109-945b-4407-8d7e-efe7f883b415 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:28.465849 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-121e0109-945b-4407-8d7e-efe7f883b415 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:28.467008 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-121e0109-945b-4407-8d7e-efe7f883b415 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1722 microversion: 2.20 time: 0.232886 Aug 31 19:26:28.467567 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 532/1065] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:28 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1722 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:29.490638 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-9a5dd188-01f3-467b-a690-9c2d9207fd93 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:29.491295 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-9a5dd188-01f3-467b-a690-9c2d9207fd93 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:29.498471 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9a5dd188-01f3-467b-a690-9c2d9207fd93 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:29.498948 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9a5dd188-01f3-467b-a690-9c2d9207fd93 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:29.499374 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9a5dd188-01f3-467b-a690-9c2d9207fd93 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:29.500058 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9a5dd188-01f3-467b-a690-9c2d9207fd93 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:29.500506 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9a5dd188-01f3-467b-a690-9c2d9207fd93 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:29.500923 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9a5dd188-01f3-467b-a690-9c2d9207fd93 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:29.629522 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-9a5dd188-01f3-467b-a690-9c2d9207fd93 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:29.637560 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-9a5dd188-01f3-467b-a690-9c2d9207fd93 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:29.639000 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-9a5dd188-01f3-467b-a690-9c2d9207fd93 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:29.640140 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-9a5dd188-01f3-467b-a690-9c2d9207fd93 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1722 microversion: 2.20 time: 0.153526 Aug 31 19:26:29.640699 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 534/1066] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:29 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:30.663666 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-54672aa2-3734-4a35-b2aa-fd34e96633cb tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:30.664259 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-54672aa2-3734-4a35-b2aa-fd34e96633cb tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:30.671054 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-54672aa2-3734-4a35-b2aa-fd34e96633cb tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:30.671550 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-54672aa2-3734-4a35-b2aa-fd34e96633cb tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:30.671985 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-54672aa2-3734-4a35-b2aa-fd34e96633cb tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:30.672698 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-54672aa2-3734-4a35-b2aa-fd34e96633cb tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:30.673153 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-54672aa2-3734-4a35-b2aa-fd34e96633cb tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:30.673603 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-54672aa2-3734-4a35-b2aa-fd34e96633cb tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:30.807911 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-54672aa2-3734-4a35-b2aa-fd34e96633cb tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:30.815861 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-54672aa2-3734-4a35-b2aa-fd34e96633cb tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:30.817336 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-54672aa2-3734-4a35-b2aa-fd34e96633cb tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:30.818497 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-54672aa2-3734-4a35-b2aa-fd34e96633cb tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1743 microversion: 2.20 time: 0.159370 Aug 31 19:26:30.819048 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 533/1067] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:30 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:31.842491 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-2c1bc044-44b5-45a5-8412-11bd7171b78f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:31.843148 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-2c1bc044-44b5-45a5-8412-11bd7171b78f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:31.849765 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2c1bc044-44b5-45a5-8412-11bd7171b78f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:31.850850 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2c1bc044-44b5-45a5-8412-11bd7171b78f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:31.851279 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2c1bc044-44b5-45a5-8412-11bd7171b78f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:31.851954 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2c1bc044-44b5-45a5-8412-11bd7171b78f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:31.852399 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2c1bc044-44b5-45a5-8412-11bd7171b78f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:31.852814 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2c1bc044-44b5-45a5-8412-11bd7171b78f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:31.979159 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-2c1bc044-44b5-45a5-8412-11bd7171b78f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:31.987215 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-2c1bc044-44b5-45a5-8412-11bd7171b78f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:31.988652 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-2c1bc044-44b5-45a5-8412-11bd7171b78f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:31.989833 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-2c1bc044-44b5-45a5-8412-11bd7171b78f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1743 microversion: 2.20 time: 0.151309 Aug 31 19:26:31.990380 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 535/1068] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:31 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1743 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:33.013314 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-4e746240-ed5f-4fdc-9ef3-e04a95fd1906 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:33.013928 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-4e746240-ed5f-4fdc-9ef3-e04a95fd1906 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:33.020346 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4e746240-ed5f-4fdc-9ef3-e04a95fd1906 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:33.020832 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4e746240-ed5f-4fdc-9ef3-e04a95fd1906 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:33.021294 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4e746240-ed5f-4fdc-9ef3-e04a95fd1906 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:33.021990 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4e746240-ed5f-4fdc-9ef3-e04a95fd1906 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:33.023107 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4e746240-ed5f-4fdc-9ef3-e04a95fd1906 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:33.023533 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4e746240-ed5f-4fdc-9ef3-e04a95fd1906 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:33.150914 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-4e746240-ed5f-4fdc-9ef3-e04a95fd1906 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:33.158864 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-4e746240-ed5f-4fdc-9ef3-e04a95fd1906 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:33.160615 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-4e746240-ed5f-4fdc-9ef3-e04a95fd1906 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:33.161816 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-4e746240-ed5f-4fdc-9ef3-e04a95fd1906 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1743 microversion: 2.20 time: 0.152532 Aug 31 19:26:33.162381 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 534/1069] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:33 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1743 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:34.184345 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-fee88cca-06a1-4325-a11e-7c65a8785623 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:34.184952 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-fee88cca-06a1-4325-a11e-7c65a8785623 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:34.194248 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fee88cca-06a1-4325-a11e-7c65a8785623 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:34.194248 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fee88cca-06a1-4325-a11e-7c65a8785623 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:34.194248 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fee88cca-06a1-4325-a11e-7c65a8785623 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:34.194248 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fee88cca-06a1-4325-a11e-7c65a8785623 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:34.194669 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fee88cca-06a1-4325-a11e-7c65a8785623 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:34.194669 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fee88cca-06a1-4325-a11e-7c65a8785623 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:34.333660 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-fee88cca-06a1-4325-a11e-7c65a8785623 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:34.342296 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-fee88cca-06a1-4325-a11e-7c65a8785623 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:34.343809 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-fee88cca-06a1-4325-a11e-7c65a8785623 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:34.345461 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-fee88cca-06a1-4325-a11e-7c65a8785623 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1743 microversion: 2.20 time: 0.164744 Aug 31 19:26:34.346212 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 536/1070] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:34 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1743 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:34.425177 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-2201f62f-de15-49c4-9e76-84062c0afa0e req-d2b65c78-fdc7-4ae9-8349-bd0ce4b7c8cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb51cb62-2a6e-493d-94b7-48486f626d56", "name": "network-vif-plugged", "status": "completed", "tag": "9e4f721b-2045-49c9-a2a8-2ed988b63507"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:26:34.438989 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-2201f62f-de15-49c4-9e76-84062c0afa0e req-d2b65c78-fdc7-4ae9-8349-bd0ce4b7c8cf service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:34.439462 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-2201f62f-de15-49c4-9e76-84062c0afa0e req-d2b65c78-fdc7-4ae9-8349-bd0ce4b7c8cf service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:34.439888 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-2201f62f-de15-49c4-9e76-84062c0afa0e req-d2b65c78-fdc7-4ae9-8349-bd0ce4b7c8cf service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:34.451099 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-2201f62f-de15-49c4-9e76-84062c0afa0e req-d2b65c78-fdc7-4ae9-8349-bd0ce4b7c8cf service nova] Creating event network-vif-plugged:9e4f721b-2045-49c9-a2a8-2ed988b63507 for instance eb51cb62-2a6e-493d-94b7-48486f626d56 on hv-cinder-83538 Aug 31 19:26:34.456360 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-2201f62f-de15-49c4-9e76-84062c0afa0e req-d2b65c78-fdc7-4ae9-8349-bd0ce4b7c8cf service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034759 Aug 31 19:26:34.457501 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 535/1071] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:26:35.368561 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-aea4a415-626c-4042-9e25-2228a44ca02f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:35.369174 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-aea4a415-626c-4042-9e25-2228a44ca02f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:35.375634 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-aea4a415-626c-4042-9e25-2228a44ca02f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:35.376119 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-aea4a415-626c-4042-9e25-2228a44ca02f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:35.376554 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-aea4a415-626c-4042-9e25-2228a44ca02f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:35.377277 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-aea4a415-626c-4042-9e25-2228a44ca02f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:35.377732 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-aea4a415-626c-4042-9e25-2228a44ca02f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:35.378158 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-aea4a415-626c-4042-9e25-2228a44ca02f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:35.504122 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-aea4a415-626c-4042-9e25-2228a44ca02f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:35.512766 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-aea4a415-626c-4042-9e25-2228a44ca02f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:35.514237 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-aea4a415-626c-4042-9e25-2228a44ca02f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:35.515396 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-aea4a415-626c-4042-9e25-2228a44ca02f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1743 microversion: 2.20 time: 0.151220 Aug 31 19:26:35.515958 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 537/1072] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:35 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1743 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:36.538944 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-3711b288-a18d-4b9c-8c15-252bd9941afb tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:36.539947 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-3711b288-a18d-4b9c-8c15-252bd9941afb tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:36.546519 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3711b288-a18d-4b9c-8c15-252bd9941afb tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:36.546996 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3711b288-a18d-4b9c-8c15-252bd9941afb tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:36.547421 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3711b288-a18d-4b9c-8c15-252bd9941afb tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:36.548105 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3711b288-a18d-4b9c-8c15-252bd9941afb tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:36.548555 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3711b288-a18d-4b9c-8c15-252bd9941afb tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:36.548974 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3711b288-a18d-4b9c-8c15-252bd9941afb tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:36.680466 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-3711b288-a18d-4b9c-8c15-252bd9941afb tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:36.688930 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-3711b288-a18d-4b9c-8c15-252bd9941afb tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:36.690383 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-3711b288-a18d-4b9c-8c15-252bd9941afb tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:36.691529 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-3711b288-a18d-4b9c-8c15-252bd9941afb tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1743 microversion: 2.20 time: 0.157496 Aug 31 19:26:36.692078 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 536/1073] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:36 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:37.714886 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-3db1e4ca-0bc8-4469-b83c-148958d0d481 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:37.715999 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-3db1e4ca-0bc8-4469-b83c-148958d0d481 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:37.724312 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3db1e4ca-0bc8-4469-b83c-148958d0d481 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:37.724804 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3db1e4ca-0bc8-4469-b83c-148958d0d481 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:37.725530 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3db1e4ca-0bc8-4469-b83c-148958d0d481 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:37.726628 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3db1e4ca-0bc8-4469-b83c-148958d0d481 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:37.727091 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3db1e4ca-0bc8-4469-b83c-148958d0d481 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:37.727522 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3db1e4ca-0bc8-4469-b83c-148958d0d481 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:37.875101 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-3db1e4ca-0bc8-4469-b83c-148958d0d481 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:37.885375 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-3db1e4ca-0bc8-4469-b83c-148958d0d481 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:37.887065 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-3db1e4ca-0bc8-4469-b83c-148958d0d481 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:37.888301 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-3db1e4ca-0bc8-4469-b83c-148958d0d481 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1738 microversion: 2.20 time: 0.178118 Aug 31 19:26:37.888857 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 538/1074] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:37 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1738 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:38.913756 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-44b5f222-61a9-4ceb-8765-b7ffb9216eae tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:38.914380 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-44b5f222-61a9-4ceb-8765-b7ffb9216eae tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:38.921641 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-44b5f222-61a9-4ceb-8765-b7ffb9216eae tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:38.922137 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-44b5f222-61a9-4ceb-8765-b7ffb9216eae tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:38.922573 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-44b5f222-61a9-4ceb-8765-b7ffb9216eae tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:38.923268 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-44b5f222-61a9-4ceb-8765-b7ffb9216eae tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:38.923720 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-44b5f222-61a9-4ceb-8765-b7ffb9216eae tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:38.924141 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-44b5f222-61a9-4ceb-8765-b7ffb9216eae tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:39.064769 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-44b5f222-61a9-4ceb-8765-b7ffb9216eae tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:39.073515 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-44b5f222-61a9-4ceb-8765-b7ffb9216eae tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:39.074951 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-44b5f222-61a9-4ceb-8765-b7ffb9216eae tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:39.076378 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-44b5f222-61a9-4ceb-8765-b7ffb9216eae tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1738 microversion: 2.20 time: 0.167639 Aug 31 19:26:39.077168 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 537/1075] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:38 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:40.101887 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-1bfb9358-0522-43f4-a940-b076e78332fc tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:40.102718 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-1bfb9358-0522-43f4-a940-b076e78332fc tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:40.109480 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1bfb9358-0522-43f4-a940-b076e78332fc tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:40.110180 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1bfb9358-0522-43f4-a940-b076e78332fc tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:40.110810 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1bfb9358-0522-43f4-a940-b076e78332fc tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:40.111512 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1bfb9358-0522-43f4-a940-b076e78332fc tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:40.111968 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1bfb9358-0522-43f4-a940-b076e78332fc tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:40.112437 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1bfb9358-0522-43f4-a940-b076e78332fc tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:40.270911 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1bfb9358-0522-43f4-a940-b076e78332fc tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:40.280106 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1bfb9358-0522-43f4-a940-b076e78332fc tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:40.281643 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1bfb9358-0522-43f4-a940-b076e78332fc tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:40.282881 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-1bfb9358-0522-43f4-a940-b076e78332fc tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1738 microversion: 2.20 time: 0.185881 Aug 31 19:26:40.283363 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 539/1076] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:40 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1738 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:41.306884 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-1f54995c-24a6-4e4b-ac7f-3ee42f988a0c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:41.308153 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-1f54995c-24a6-4e4b-ac7f-3ee42f988a0c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:41.314424 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1f54995c-24a6-4e4b-ac7f-3ee42f988a0c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:41.314908 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1f54995c-24a6-4e4b-ac7f-3ee42f988a0c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:41.315534 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1f54995c-24a6-4e4b-ac7f-3ee42f988a0c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:41.316475 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1f54995c-24a6-4e4b-ac7f-3ee42f988a0c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:41.317006 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1f54995c-24a6-4e4b-ac7f-3ee42f988a0c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:41.317537 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1f54995c-24a6-4e4b-ac7f-3ee42f988a0c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:41.470315 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-1f54995c-24a6-4e4b-ac7f-3ee42f988a0c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:41.480805 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-1f54995c-24a6-4e4b-ac7f-3ee42f988a0c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:41.482551 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-1f54995c-24a6-4e4b-ac7f-3ee42f988a0c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:41.483729 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-1f54995c-24a6-4e4b-ac7f-3ee42f988a0c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1738 microversion: 2.20 time: 0.180777 Aug 31 19:26:41.484283 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 538/1077] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:41 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1738 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:42.506211 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-df5124eb-9735-4e4e-a434-ac2befe2023f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:42.506862 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-df5124eb-9735-4e4e-a434-ac2befe2023f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:42.513800 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-df5124eb-9735-4e4e-a434-ac2befe2023f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:42.514295 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-df5124eb-9735-4e4e-a434-ac2befe2023f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:42.514734 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-df5124eb-9735-4e4e-a434-ac2befe2023f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:42.515431 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-df5124eb-9735-4e4e-a434-ac2befe2023f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:42.515890 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-df5124eb-9735-4e4e-a434-ac2befe2023f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:42.516317 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-df5124eb-9735-4e4e-a434-ac2befe2023f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:42.660533 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-df5124eb-9735-4e4e-a434-ac2befe2023f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:42.669793 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-df5124eb-9735-4e4e-a434-ac2befe2023f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:42.671239 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-df5124eb-9735-4e4e-a434-ac2befe2023f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:42.672415 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-df5124eb-9735-4e4e-a434-ac2befe2023f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1738 microversion: 2.20 time: 0.170123 Aug 31 19:26:42.672972 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 540/1078] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:42 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1738 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:43.698383 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-f04d1e4c-1cc0-4f80-b9d8-a586e5826a64 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:43.699019 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-f04d1e4c-1cc0-4f80-b9d8-a586e5826a64 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:43.706748 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f04d1e4c-1cc0-4f80-b9d8-a586e5826a64 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:43.707236 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f04d1e4c-1cc0-4f80-b9d8-a586e5826a64 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:43.707668 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f04d1e4c-1cc0-4f80-b9d8-a586e5826a64 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:43.708361 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f04d1e4c-1cc0-4f80-b9d8-a586e5826a64 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:43.708875 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f04d1e4c-1cc0-4f80-b9d8-a586e5826a64 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:43.709509 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f04d1e4c-1cc0-4f80-b9d8-a586e5826a64 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:43.849959 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-f04d1e4c-1cc0-4f80-b9d8-a586e5826a64 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:43.858874 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-f04d1e4c-1cc0-4f80-b9d8-a586e5826a64 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:43.860307 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-f04d1e4c-1cc0-4f80-b9d8-a586e5826a64 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:43.861556 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-f04d1e4c-1cc0-4f80-b9d8-a586e5826a64 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1738 microversion: 2.20 time: 0.168608 Aug 31 19:26:43.862512 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 539/1079] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:43 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:44.887558 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-8f7e5de6-8932-4fe7-8300-a0a0894d3a35 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:44.888299 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-8f7e5de6-8932-4fe7-8300-a0a0894d3a35 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:44.896585 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8f7e5de6-8932-4fe7-8300-a0a0894d3a35 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:44.897234 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8f7e5de6-8932-4fe7-8300-a0a0894d3a35 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:44.897678 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8f7e5de6-8932-4fe7-8300-a0a0894d3a35 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:44.898817 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8f7e5de6-8932-4fe7-8300-a0a0894d3a35 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:44.899810 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8f7e5de6-8932-4fe7-8300-a0a0894d3a35 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:44.900241 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8f7e5de6-8932-4fe7-8300-a0a0894d3a35 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:45.068203 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-8f7e5de6-8932-4fe7-8300-a0a0894d3a35 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:45.076659 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-8f7e5de6-8932-4fe7-8300-a0a0894d3a35 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:45.079140 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-8f7e5de6-8932-4fe7-8300-a0a0894d3a35 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:45.081584 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-8f7e5de6-8932-4fe7-8300-a0a0894d3a35 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1738 microversion: 2.20 time: 0.198175 Aug 31 19:26:45.098427 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 541/1080] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:44 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1738 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:46.108862 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-36ed7f60-28ce-4c43-b6a6-c6fe1cc1de73 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:46.109644 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-36ed7f60-28ce-4c43-b6a6-c6fe1cc1de73 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:46.116643 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-36ed7f60-28ce-4c43-b6a6-c6fe1cc1de73 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:46.117123 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-36ed7f60-28ce-4c43-b6a6-c6fe1cc1de73 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:46.117577 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-36ed7f60-28ce-4c43-b6a6-c6fe1cc1de73 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:46.118356 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-36ed7f60-28ce-4c43-b6a6-c6fe1cc1de73 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:46.119048 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-36ed7f60-28ce-4c43-b6a6-c6fe1cc1de73 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:46.119478 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-36ed7f60-28ce-4c43-b6a6-c6fe1cc1de73 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:46.255237 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-36ed7f60-28ce-4c43-b6a6-c6fe1cc1de73 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:46.264713 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-36ed7f60-28ce-4c43-b6a6-c6fe1cc1de73 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:46.266179 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-36ed7f60-28ce-4c43-b6a6-c6fe1cc1de73 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:46.267505 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-36ed7f60-28ce-4c43-b6a6-c6fe1cc1de73 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1738 microversion: 2.20 time: 0.163911 Aug 31 19:26:46.281209 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 540/1081] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:46 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1738 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:47.292055 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-99a01e96-23d3-4402-9f55-fb5ab8fc2076 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:47.293646 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-99a01e96-23d3-4402-9f55-fb5ab8fc2076 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:47.300423 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-99a01e96-23d3-4402-9f55-fb5ab8fc2076 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:47.300912 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-99a01e96-23d3-4402-9f55-fb5ab8fc2076 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:47.301504 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-99a01e96-23d3-4402-9f55-fb5ab8fc2076 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:47.304918 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-99a01e96-23d3-4402-9f55-fb5ab8fc2076 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:47.304918 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-99a01e96-23d3-4402-9f55-fb5ab8fc2076 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:47.304918 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-99a01e96-23d3-4402-9f55-fb5ab8fc2076 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:47.458272 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-99a01e96-23d3-4402-9f55-fb5ab8fc2076 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:47.468362 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-99a01e96-23d3-4402-9f55-fb5ab8fc2076 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:47.470572 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-99a01e96-23d3-4402-9f55-fb5ab8fc2076 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:47.472117 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-99a01e96-23d3-4402-9f55-fb5ab8fc2076 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1738 microversion: 2.20 time: 0.184872 Aug 31 19:26:47.473409 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 542/1082] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:47 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1738 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:48.496891 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-054dc7d2-d182-4ab7-b5e8-fbcf6b3a08c8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:48.497515 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-054dc7d2-d182-4ab7-b5e8-fbcf6b3a08c8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:48.499604 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_api:SELECT=29 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:48.504982 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-054dc7d2-d182-4ab7-b5e8-fbcf6b3a08c8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:48.505612 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-054dc7d2-d182-4ab7-b5e8-fbcf6b3a08c8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:48.506044 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-054dc7d2-d182-4ab7-b5e8-fbcf6b3a08c8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:48.506772 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-054dc7d2-d182-4ab7-b5e8-fbcf6b3a08c8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:48.507221 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-054dc7d2-d182-4ab7-b5e8-fbcf6b3a08c8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:48.507635 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-054dc7d2-d182-4ab7-b5e8-fbcf6b3a08c8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:48.510348 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=79 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:48.641181 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-054dc7d2-d182-4ab7-b5e8-fbcf6b3a08c8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:48.649082 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-054dc7d2-d182-4ab7-b5e8-fbcf6b3a08c8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:48.650537 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-054dc7d2-d182-4ab7-b5e8-fbcf6b3a08c8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:48.651691 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-054dc7d2-d182-4ab7-b5e8-fbcf6b3a08c8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1738 microversion: 2.20 time: 0.160207 Aug 31 19:26:48.652238 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 541/1083] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:48 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:26:49.674547 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-35e9496b-c013-40c7-876c-223a265c6de1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:49.675158 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-35e9496b-c013-40c7-876c-223a265c6de1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:49.677569 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=29 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:49.683987 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-35e9496b-c013-40c7-876c-223a265c6de1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:49.684595 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-35e9496b-c013-40c7-876c-223a265c6de1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:49.685041 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-35e9496b-c013-40c7-876c-223a265c6de1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:49.685849 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-35e9496b-c013-40c7-876c-223a265c6de1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:49.686349 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-35e9496b-c013-40c7-876c-223a265c6de1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:49.686800 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-35e9496b-c013-40c7-876c-223a265c6de1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:49.689721 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:49.823154 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-35e9496b-c013-40c7-876c-223a265c6de1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:49.831281 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-35e9496b-c013-40c7-876c-223a265c6de1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:49.832716 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-35e9496b-c013-40c7-876c-223a265c6de1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:49.833890 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-35e9496b-c013-40c7-876c-223a265c6de1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1720 microversion: 2.20 time: 0.163294 Aug 31 19:26:49.834557 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 543/1084] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:49 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:50.857745 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-d5cfbe4a-fdd1-403e-9a3e-e0d7ea93b210 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:50.858430 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-d5cfbe4a-fdd1-403e-9a3e-e0d7ea93b210 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:50.865726 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d5cfbe4a-fdd1-403e-9a3e-e0d7ea93b210 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:50.866212 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d5cfbe4a-fdd1-403e-9a3e-e0d7ea93b210 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:50.866647 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d5cfbe4a-fdd1-403e-9a3e-e0d7ea93b210 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:50.867341 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d5cfbe4a-fdd1-403e-9a3e-e0d7ea93b210 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:50.867794 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d5cfbe4a-fdd1-403e-9a3e-e0d7ea93b210 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:50.868222 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d5cfbe4a-fdd1-403e-9a3e-e0d7ea93b210 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:50.995887 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-d5cfbe4a-fdd1-403e-9a3e-e0d7ea93b210 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:51.003774 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-d5cfbe4a-fdd1-403e-9a3e-e0d7ea93b210 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:51.005181 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-d5cfbe4a-fdd1-403e-9a3e-e0d7ea93b210 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:51.006827 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-d5cfbe4a-fdd1-403e-9a3e-e0d7ea93b210 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1720 microversion: 2.20 time: 0.152925 Aug 31 19:26:51.007380 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 542/1085] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:50 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:52.029254 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-3cbea02b-6269-4cc8-a118-d810aa56c17a tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:52.029897 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-3cbea02b-6269-4cc8-a118-d810aa56c17a tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:52.035981 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3cbea02b-6269-4cc8-a118-d810aa56c17a tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:52.036471 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3cbea02b-6269-4cc8-a118-d810aa56c17a tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:52.036908 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3cbea02b-6269-4cc8-a118-d810aa56c17a tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:52.038226 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3cbea02b-6269-4cc8-a118-d810aa56c17a tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:52.038683 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3cbea02b-6269-4cc8-a118-d810aa56c17a tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:52.039108 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3cbea02b-6269-4cc8-a118-d810aa56c17a tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:52.164663 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-3cbea02b-6269-4cc8-a118-d810aa56c17a tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:52.172586 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-3cbea02b-6269-4cc8-a118-d810aa56c17a tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:52.174029 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-3cbea02b-6269-4cc8-a118-d810aa56c17a tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:52.175167 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-3cbea02b-6269-4cc8-a118-d810aa56c17a tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1663 microversion: 2.20 time: 0.150051 Aug 31 19:26:52.175717 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 544/1086] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:52 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1663 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:52.198119 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-ab882198-934e-42e8-95cf-0d0ac27ff030 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "43ad7985-86b9-456a-8ead-fefa63394e19"}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:26:52.200540 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-ab882198-934e-42e8-95cf-0d0ac27ff030 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:52.206913 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ab882198-934e-42e8-95cf-0d0ac27ff030 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:52.207392 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ab882198-934e-42e8-95cf-0d0ac27ff030 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:52.207821 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ab882198-934e-42e8-95cf-0d0ac27ff030 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:52.208508 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ab882198-934e-42e8-95cf-0d0ac27ff030 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:52.208956 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ab882198-934e-42e8-95cf-0d0ac27ff030 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:52.209526 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ab882198-934e-42e8-95cf-0d0ac27ff030 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:52.485568 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-ab882198-934e-42e8-95cf-0d0ac27ff030 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "POST /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.292029 Aug 31 19:26:52.486368 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 543/1087] 10.222.0.65 () {62 vars in 1364 bytes} [Wed Aug 31 19:26:52 2022] POST /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56/os-volume_attachments => generated 188 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 19:26:52.506117 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-e8e29964-2bcd-484f-be23-8417f295f493 req-40529dc7-4d63-499f-9974-cc6b158c6ba1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb51cb62-2a6e-493d-94b7-48486f626d56", "name": "network-vif-unplugged", "status": "completed", "tag": "9e4f721b-2045-49c9-a2a8-2ed988b63507"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:26:52.521583 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-e8e29964-2bcd-484f-be23-8417f295f493 req-40529dc7-4d63-499f-9974-cc6b158c6ba1 service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:52.523092 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-e8e29964-2bcd-484f-be23-8417f295f493 req-40529dc7-4d63-499f-9974-cc6b158c6ba1 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:52.523530 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-e8e29964-2bcd-484f-be23-8417f295f493 req-40529dc7-4d63-499f-9974-cc6b158c6ba1 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:52.535871 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.compute.server_external_events [req-e8e29964-2bcd-484f-be23-8417f295f493 req-40529dc7-4d63-499f-9974-cc6b158c6ba1 service nova] Unable to find a host for instance eb51cb62-2a6e-493d-94b7-48486f626d56. Dropping event network-vif-unplugged {{(pid=120623) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 31 19:26:52.541816 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-e8e29964-2bcd-484f-be23-8417f295f493 req-40529dc7-4d63-499f-9974-cc6b158c6ba1 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.034511 Aug 31 19:26:52.541816 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 545/1088] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:26:52 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 31 19:26:52.609856 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-08eee690-2349-49c8-b436-ab1bd87c61de tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:52.610366 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-08eee690-2349-49c8-b436-ab1bd87c61de tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:52.617464 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-08eee690-2349-49c8-b436-ab1bd87c61de tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:52.617948 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-08eee690-2349-49c8-b436-ab1bd87c61de tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:52.618385 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-08eee690-2349-49c8-b436-ab1bd87c61de tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:52.619076 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-08eee690-2349-49c8-b436-ab1bd87c61de tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:52.619532 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-08eee690-2349-49c8-b436-ab1bd87c61de tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:52.619957 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-08eee690-2349-49c8-b436-ab1bd87c61de tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:52.849824 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-08eee690-2349-49c8-b436-ab1bd87c61de tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "DELETE /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56/os-volume_attachments/43ad7985-86b9-456a-8ead-fefa63394e19" status: 202 len: 0 microversion: 2.20 time: 0.243849 Aug 31 19:26:52.850758 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 544/1089] 10.222.0.65 () {60 vars in 1457 bytes} [Wed Aug 31 19:26:52 2022] DELETE /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56/os-volume_attachments/43ad7985-86b9-456a-8ead-fefa63394e19 => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:26:52.909057 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-51ff9ea2-a631-48ba-85cd-4b7c8cfc6b79 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:26:52.909768 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-51ff9ea2-a631-48ba-85cd-4b7c8cfc6b79 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:52.916193 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-51ff9ea2-a631-48ba-85cd-4b7c8cfc6b79 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:52.916666 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-51ff9ea2-a631-48ba-85cd-4b7c8cfc6b79 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:52.917092 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-51ff9ea2-a631-48ba-85cd-4b7c8cfc6b79 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:52.917803 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-51ff9ea2-a631-48ba-85cd-4b7c8cfc6b79 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:52.918254 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-51ff9ea2-a631-48ba-85cd-4b7c8cfc6b79 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:52.918668 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-51ff9ea2-a631-48ba-85cd-4b7c8cfc6b79 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:52.947257 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-51ff9ea2-a631-48ba-85cd-4b7c8cfc6b79 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120623) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 19:26:53.013131 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-51ff9ea2-a631-48ba-85cd-4b7c8cfc6b79 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "POST /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56/action" status: 202 len: 0 microversion: 2.20 time: 0.107993 Aug 31 19:26:53.013760 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 546/1090] 10.222.0.65 () {62 vars in 1319 bytes} [Wed Aug 31 19:26:52 2022] POST /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:26:53.021920 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-dde6f3fa-119c-44ec-a31b-228a3aa0efd3 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:53.022537 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-dde6f3fa-119c-44ec-a31b-228a3aa0efd3 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:53.028399 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dde6f3fa-119c-44ec-a31b-228a3aa0efd3 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:53.028882 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dde6f3fa-119c-44ec-a31b-228a3aa0efd3 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:53.029344 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dde6f3fa-119c-44ec-a31b-228a3aa0efd3 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:53.030036 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dde6f3fa-119c-44ec-a31b-228a3aa0efd3 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:53.030487 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dde6f3fa-119c-44ec-a31b-228a3aa0efd3 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:53.030908 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dde6f3fa-119c-44ec-a31b-228a3aa0efd3 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:53.170707 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-dde6f3fa-119c-44ec-a31b-228a3aa0efd3 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:53.179400 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-dde6f3fa-119c-44ec-a31b-228a3aa0efd3 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:53.180855 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-dde6f3fa-119c-44ec-a31b-228a3aa0efd3 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:53.182047 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-dde6f3fa-119c-44ec-a31b-228a3aa0efd3 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1671 microversion: 2.20 time: 0.164143 Aug 31 19:26:53.182608 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 545/1091] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:53 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1671 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:54.204375 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-fee6994d-d73e-41cd-98c8-90bec874220a tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:54.204981 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-fee6994d-d73e-41cd-98c8-90bec874220a tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:54.211274 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fee6994d-d73e-41cd-98c8-90bec874220a tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:54.211922 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fee6994d-d73e-41cd-98c8-90bec874220a tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:54.212513 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fee6994d-d73e-41cd-98c8-90bec874220a tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:54.213373 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fee6994d-d73e-41cd-98c8-90bec874220a tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:54.214544 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fee6994d-d73e-41cd-98c8-90bec874220a tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:54.215060 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fee6994d-d73e-41cd-98c8-90bec874220a tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:54.349470 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-fee6994d-d73e-41cd-98c8-90bec874220a tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:54.358803 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-fee6994d-d73e-41cd-98c8-90bec874220a tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:54.360236 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-fee6994d-d73e-41cd-98c8-90bec874220a tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:54.361416 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-fee6994d-d73e-41cd-98c8-90bec874220a tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1729 microversion: 2.20 time: 0.161423 Aug 31 19:26:54.361974 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 547/1092] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:54 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:55.384332 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-9c3be2d6-2c3b-46fe-9c18-5e44252bac2f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:55.385065 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-9c3be2d6-2c3b-46fe-9c18-5e44252bac2f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:55.392441 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9c3be2d6-2c3b-46fe-9c18-5e44252bac2f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:55.393290 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9c3be2d6-2c3b-46fe-9c18-5e44252bac2f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:55.394223 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9c3be2d6-2c3b-46fe-9c18-5e44252bac2f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:55.395194 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9c3be2d6-2c3b-46fe-9c18-5e44252bac2f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:55.396006 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9c3be2d6-2c3b-46fe-9c18-5e44252bac2f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:55.396903 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9c3be2d6-2c3b-46fe-9c18-5e44252bac2f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:55.575930 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-9c3be2d6-2c3b-46fe-9c18-5e44252bac2f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:55.583890 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-9c3be2d6-2c3b-46fe-9c18-5e44252bac2f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:55.585367 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-9c3be2d6-2c3b-46fe-9c18-5e44252bac2f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:55.586515 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-9c3be2d6-2c3b-46fe-9c18-5e44252bac2f tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1729 microversion: 2.20 time: 0.206305 Aug 31 19:26:55.587062 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 546/1093] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:55 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1729 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:56.608993 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-eaef8a89-e86d-4e9e-8cbb-b208f902f932 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:56.610342 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-eaef8a89-e86d-4e9e-8cbb-b208f902f932 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:56.617953 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-eaef8a89-e86d-4e9e-8cbb-b208f902f932 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:56.618931 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-eaef8a89-e86d-4e9e-8cbb-b208f902f932 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:56.619617 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-eaef8a89-e86d-4e9e-8cbb-b208f902f932 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:56.620559 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-eaef8a89-e86d-4e9e-8cbb-b208f902f932 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:56.621243 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-eaef8a89-e86d-4e9e-8cbb-b208f902f932 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:56.621890 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-eaef8a89-e86d-4e9e-8cbb-b208f902f932 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:56.767203 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-eaef8a89-e86d-4e9e-8cbb-b208f902f932 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:56.777774 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-eaef8a89-e86d-4e9e-8cbb-b208f902f932 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:56.779454 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-eaef8a89-e86d-4e9e-8cbb-b208f902f932 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:56.780777 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-eaef8a89-e86d-4e9e-8cbb-b208f902f932 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1729 microversion: 2.20 time: 0.176124 Aug 31 19:26:56.794613 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 548/1094] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:56 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1729 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:57.804031 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-ecb15136-5a54-4b02-83e6-bb393cf5d79d tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:57.804590 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-ecb15136-5a54-4b02-83e6-bb393cf5d79d tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:57.811056 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ecb15136-5a54-4b02-83e6-bb393cf5d79d tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:57.811538 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ecb15136-5a54-4b02-83e6-bb393cf5d79d tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:57.811972 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ecb15136-5a54-4b02-83e6-bb393cf5d79d tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:57.812661 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ecb15136-5a54-4b02-83e6-bb393cf5d79d tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:57.813115 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ecb15136-5a54-4b02-83e6-bb393cf5d79d tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:57.813641 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ecb15136-5a54-4b02-83e6-bb393cf5d79d tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:57.967426 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-ecb15136-5a54-4b02-83e6-bb393cf5d79d tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:57.976246 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-ecb15136-5a54-4b02-83e6-bb393cf5d79d tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:57.977694 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-ecb15136-5a54-4b02-83e6-bb393cf5d79d tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:57.978837 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-ecb15136-5a54-4b02-83e6-bb393cf5d79d tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1729 microversion: 2.20 time: 0.178901 Aug 31 19:26:57.979515 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 547/1095] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:57 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:59.001548 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-55f0c29f-2f39-4bfd-8599-b88614d6de85 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:59.002321 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-55f0c29f-2f39-4bfd-8599-b88614d6de85 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:59.008771 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-55f0c29f-2f39-4bfd-8599-b88614d6de85 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:59.009356 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-55f0c29f-2f39-4bfd-8599-b88614d6de85 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:59.010143 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-55f0c29f-2f39-4bfd-8599-b88614d6de85 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:59.011072 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-55f0c29f-2f39-4bfd-8599-b88614d6de85 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:59.011743 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-55f0c29f-2f39-4bfd-8599-b88614d6de85 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:59.012376 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-55f0c29f-2f39-4bfd-8599-b88614d6de85 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:59.150455 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-55f0c29f-2f39-4bfd-8599-b88614d6de85 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:59.158772 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-55f0c29f-2f39-4bfd-8599-b88614d6de85 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:59.160254 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-55f0c29f-2f39-4bfd-8599-b88614d6de85 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:59.161450 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-55f0c29f-2f39-4bfd-8599-b88614d6de85 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1729 microversion: 2.20 time: 0.163783 Aug 31 19:26:59.162020 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 549/1096] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:58 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:27:00.185063 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-7811b425-6fe3-4a13-af8e-9709abc7a1bd tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:00.186650 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-7811b425-6fe3-4a13-af8e-9709abc7a1bd tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:00.194693 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7811b425-6fe3-4a13-af8e-9709abc7a1bd tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:00.195532 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7811b425-6fe3-4a13-af8e-9709abc7a1bd tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:00.196195 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7811b425-6fe3-4a13-af8e-9709abc7a1bd tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:00.197205 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7811b425-6fe3-4a13-af8e-9709abc7a1bd tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:00.198576 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7811b425-6fe3-4a13-af8e-9709abc7a1bd tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:00.199022 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7811b425-6fe3-4a13-af8e-9709abc7a1bd tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:00.339221 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-7811b425-6fe3-4a13-af8e-9709abc7a1bd tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:00.347492 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-7811b425-6fe3-4a13-af8e-9709abc7a1bd tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:00.348934 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-7811b425-6fe3-4a13-af8e-9709abc7a1bd tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:00.350148 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-7811b425-6fe3-4a13-af8e-9709abc7a1bd tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1729 microversion: 2.20 time: 0.169150 Aug 31 19:27:00.350704 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 548/1097] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:27:00 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:27:01.373872 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-61c706a5-2264-4f6a-9015-e34b1a1c7df6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:01.375648 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-61c706a5-2264-4f6a-9015-e34b1a1c7df6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:01.384179 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-61c706a5-2264-4f6a-9015-e34b1a1c7df6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:01.384743 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-61c706a5-2264-4f6a-9015-e34b1a1c7df6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:01.385273 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-61c706a5-2264-4f6a-9015-e34b1a1c7df6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:01.386250 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-61c706a5-2264-4f6a-9015-e34b1a1c7df6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:01.386862 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-61c706a5-2264-4f6a-9015-e34b1a1c7df6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:01.387350 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-61c706a5-2264-4f6a-9015-e34b1a1c7df6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:01.526340 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-61c706a5-2264-4f6a-9015-e34b1a1c7df6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:01.536867 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-61c706a5-2264-4f6a-9015-e34b1a1c7df6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:01.538989 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-61c706a5-2264-4f6a-9015-e34b1a1c7df6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:01.540389 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-61c706a5-2264-4f6a-9015-e34b1a1c7df6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1729 microversion: 2.20 time: 0.172176 Aug 31 19:27:01.541110 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 550/1098] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:27:01 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:27:02.563417 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-ec134314-1484-43a3-946f-21ac143469b4 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:02.564019 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-ec134314-1484-43a3-946f-21ac143469b4 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:02.570695 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ec134314-1484-43a3-946f-21ac143469b4 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:02.571178 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ec134314-1484-43a3-946f-21ac143469b4 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:02.571607 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ec134314-1484-43a3-946f-21ac143469b4 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:02.572291 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ec134314-1484-43a3-946f-21ac143469b4 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:02.572735 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ec134314-1484-43a3-946f-21ac143469b4 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:02.573146 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ec134314-1484-43a3-946f-21ac143469b4 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:02.703123 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-ec134314-1484-43a3-946f-21ac143469b4 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:02.711754 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-ec134314-1484-43a3-946f-21ac143469b4 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:02.713179 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-ec134314-1484-43a3-946f-21ac143469b4 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:02.714347 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-ec134314-1484-43a3-946f-21ac143469b4 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1729 microversion: 2.20 time: 0.154998 Aug 31 19:27:02.714894 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 549/1099] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:27:02 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:27:03.735865 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-3f640a11-16de-4358-98cf-5512db52e557 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:03.736408 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-3f640a11-16de-4358-98cf-5512db52e557 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:03.743551 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3f640a11-16de-4358-98cf-5512db52e557 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:03.744025 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3f640a11-16de-4358-98cf-5512db52e557 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:03.744451 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3f640a11-16de-4358-98cf-5512db52e557 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:03.745127 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3f640a11-16de-4358-98cf-5512db52e557 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:03.745595 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3f640a11-16de-4358-98cf-5512db52e557 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:03.746011 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3f640a11-16de-4358-98cf-5512db52e557 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:03.872215 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-3f640a11-16de-4358-98cf-5512db52e557 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:03.880255 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-3f640a11-16de-4358-98cf-5512db52e557 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:03.881793 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-3f640a11-16de-4358-98cf-5512db52e557 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:03.883564 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-3f640a11-16de-4358-98cf-5512db52e557 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1729 microversion: 2.20 time: 0.151144 Aug 31 19:27:03.884115 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 551/1100] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:27:03 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:27:04.905920 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-60276142-8b9c-4db8-8b49-6813dded2d05 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:04.906542 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-60276142-8b9c-4db8-8b49-6813dded2d05 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:04.912968 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-60276142-8b9c-4db8-8b49-6813dded2d05 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:04.913476 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-60276142-8b9c-4db8-8b49-6813dded2d05 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:04.913969 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-60276142-8b9c-4db8-8b49-6813dded2d05 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:04.914674 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-60276142-8b9c-4db8-8b49-6813dded2d05 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:04.915109 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-60276142-8b9c-4db8-8b49-6813dded2d05 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:04.915528 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-60276142-8b9c-4db8-8b49-6813dded2d05 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:05.042663 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-60276142-8b9c-4db8-8b49-6813dded2d05 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:05.050668 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-60276142-8b9c-4db8-8b49-6813dded2d05 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:05.052106 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-60276142-8b9c-4db8-8b49-6813dded2d05 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:05.053291 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-60276142-8b9c-4db8-8b49-6813dded2d05 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1729 microversion: 2.20 time: 0.151326 Aug 31 19:27:05.053851 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 550/1101] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:27:04 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:27:06.075582 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-b7a243cb-8b98-480b-a16d-f5443f833fc8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:06.076195 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-b7a243cb-8b98-480b-a16d-f5443f833fc8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:06.082573 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b7a243cb-8b98-480b-a16d-f5443f833fc8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:06.083053 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b7a243cb-8b98-480b-a16d-f5443f833fc8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:06.083490 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b7a243cb-8b98-480b-a16d-f5443f833fc8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:06.084321 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b7a243cb-8b98-480b-a16d-f5443f833fc8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:06.084773 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b7a243cb-8b98-480b-a16d-f5443f833fc8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:06.085216 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b7a243cb-8b98-480b-a16d-f5443f833fc8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:06.216038 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-b7a243cb-8b98-480b-a16d-f5443f833fc8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:06.224428 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-b7a243cb-8b98-480b-a16d-f5443f833fc8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:06.225935 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-b7a243cb-8b98-480b-a16d-f5443f833fc8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:06.227631 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-b7a243cb-8b98-480b-a16d-f5443f833fc8 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1729 microversion: 2.20 time: 0.156050 Aug 31 19:27:06.228193 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 552/1102] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:27:06 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:27:07.251869 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-3186f881-d3b8-4ad7-8bcf-8cfd3270b5df tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:07.252467 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-3186f881-d3b8-4ad7-8bcf-8cfd3270b5df tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:07.258996 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3186f881-d3b8-4ad7-8bcf-8cfd3270b5df tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:07.259466 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3186f881-d3b8-4ad7-8bcf-8cfd3270b5df tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:07.259890 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3186f881-d3b8-4ad7-8bcf-8cfd3270b5df tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:07.260572 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3186f881-d3b8-4ad7-8bcf-8cfd3270b5df tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:07.261010 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3186f881-d3b8-4ad7-8bcf-8cfd3270b5df tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:07.261451 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3186f881-d3b8-4ad7-8bcf-8cfd3270b5df tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:07.484800 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-3186f881-d3b8-4ad7-8bcf-8cfd3270b5df tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:07.484800 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-3186f881-d3b8-4ad7-8bcf-8cfd3270b5df tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:07.485100 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-3186f881-d3b8-4ad7-8bcf-8cfd3270b5df tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:07.485100 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-3186f881-d3b8-4ad7-8bcf-8cfd3270b5df tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1729 microversion: 2.20 time: 0.208714 Aug 31 19:27:07.485100 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 551/1103] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:27:07 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1729 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:27:08.513408 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-67c90b8d-238f-4c51-9998-22ad09b03245 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:08.514022 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-67c90b8d-238f-4c51-9998-22ad09b03245 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:08.520455 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-67c90b8d-238f-4c51-9998-22ad09b03245 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:08.520936 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-67c90b8d-238f-4c51-9998-22ad09b03245 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:08.521513 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-67c90b8d-238f-4c51-9998-22ad09b03245 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:08.522111 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-67c90b8d-238f-4c51-9998-22ad09b03245 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:08.522569 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-67c90b8d-238f-4c51-9998-22ad09b03245 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:08.522988 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-67c90b8d-238f-4c51-9998-22ad09b03245 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:08.650191 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-67c90b8d-238f-4c51-9998-22ad09b03245 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:08.658191 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-67c90b8d-238f-4c51-9998-22ad09b03245 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:08.659623 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-67c90b8d-238f-4c51-9998-22ad09b03245 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:08.660769 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-67c90b8d-238f-4c51-9998-22ad09b03245 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1729 microversion: 2.20 time: 0.151368 Aug 31 19:27:08.661351 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 553/1104] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:27:08 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:27:09.684461 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-40fe8772-0de6-403d-acbf-32d9985e67ab tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:09.685492 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-40fe8772-0de6-403d-acbf-32d9985e67ab tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:09.691592 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-40fe8772-0de6-403d-acbf-32d9985e67ab tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:09.692075 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-40fe8772-0de6-403d-acbf-32d9985e67ab tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:09.692506 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-40fe8772-0de6-403d-acbf-32d9985e67ab tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:09.693215 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-40fe8772-0de6-403d-acbf-32d9985e67ab tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:09.693671 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-40fe8772-0de6-403d-acbf-32d9985e67ab tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:09.694094 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-40fe8772-0de6-403d-acbf-32d9985e67ab tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:09.712267 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:27:09.824247 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-40fe8772-0de6-403d-acbf-32d9985e67ab tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:09.832385 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-40fe8772-0de6-403d-acbf-32d9985e67ab tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:09.833870 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-40fe8772-0de6-403d-acbf-32d9985e67ab tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:09.835036 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-40fe8772-0de6-403d-acbf-32d9985e67ab tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1729 microversion: 2.20 time: 0.155112 Aug 31 19:27:09.835594 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 552/1105] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:27:09 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:27:10.857714 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-ef5eedd5-3b8c-4be9-8f4d-fe52f710d61b tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:10.858316 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-ef5eedd5-3b8c-4be9-8f4d-fe52f710d61b tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:10.864726 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ef5eedd5-3b8c-4be9-8f4d-fe52f710d61b tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:10.865231 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ef5eedd5-3b8c-4be9-8f4d-fe52f710d61b tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:10.865670 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ef5eedd5-3b8c-4be9-8f4d-fe52f710d61b tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:10.866354 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ef5eedd5-3b8c-4be9-8f4d-fe52f710d61b tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:10.866808 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ef5eedd5-3b8c-4be9-8f4d-fe52f710d61b tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:10.867788 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ef5eedd5-3b8c-4be9-8f4d-fe52f710d61b tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:11.002719 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-ef5eedd5-3b8c-4be9-8f4d-fe52f710d61b tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:11.011404 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-ef5eedd5-3b8c-4be9-8f4d-fe52f710d61b tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:11.012847 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-ef5eedd5-3b8c-4be9-8f4d-fe52f710d61b tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:11.014031 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-ef5eedd5-3b8c-4be9-8f4d-fe52f710d61b tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1729 microversion: 2.20 time: 0.160242 Aug 31 19:27:11.014594 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 554/1106] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:27:10 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:27:12.035986 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-f9445543-3a09-42a4-8f74-1040600ff682 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:12.036621 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-f9445543-3a09-42a4-8f74-1040600ff682 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:12.043493 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f9445543-3a09-42a4-8f74-1040600ff682 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:12.043969 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f9445543-3a09-42a4-8f74-1040600ff682 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:12.044395 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f9445543-3a09-42a4-8f74-1040600ff682 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:12.045105 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f9445543-3a09-42a4-8f74-1040600ff682 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:12.045591 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f9445543-3a09-42a4-8f74-1040600ff682 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:12.046004 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f9445543-3a09-42a4-8f74-1040600ff682 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:12.173715 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-f9445543-3a09-42a4-8f74-1040600ff682 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:12.182323 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-f9445543-3a09-42a4-8f74-1040600ff682 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:12.183764 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-f9445543-3a09-42a4-8f74-1040600ff682 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:12.184918 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-f9445543-3a09-42a4-8f74-1040600ff682 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1729 microversion: 2.20 time: 0.152888 Aug 31 19:27:12.185513 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 553/1107] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:27:12 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:27:12.658739 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-1ba33907-7ede-44e7-b1b9-569f24db8966 req-39eceb3b-f793-4128-be33-28702b465667 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb51cb62-2a6e-493d-94b7-48486f626d56", "name": "network-vif-plugged", "status": "completed", "tag": "9e4f721b-2045-49c9-a2a8-2ed988b63507"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:27:12.670234 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-1ba33907-7ede-44e7-b1b9-569f24db8966 req-39eceb3b-f793-4128-be33-28702b465667 service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:12.671326 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-1ba33907-7ede-44e7-b1b9-569f24db8966 req-39eceb3b-f793-4128-be33-28702b465667 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:12.671784 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-1ba33907-7ede-44e7-b1b9-569f24db8966 req-39eceb3b-f793-4128-be33-28702b465667 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:12.683394 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-1ba33907-7ede-44e7-b1b9-569f24db8966 req-39eceb3b-f793-4128-be33-28702b465667 service nova] Creating event network-vif-plugged:9e4f721b-2045-49c9-a2a8-2ed988b63507 for instance eb51cb62-2a6e-493d-94b7-48486f626d56 on hv-cinder-83538 Aug 31 19:27:12.690299 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-1ba33907-7ede-44e7-b1b9-569f24db8966 req-39eceb3b-f793-4128-be33-28702b465667 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035195 Aug 31 19:27:12.690902 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 555/1108] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:27:13.207382 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-4493e292-b78b-4791-ad24-2c4070f26adc tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:13.207990 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-4493e292-b78b-4791-ad24-2c4070f26adc tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:13.215112 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4493e292-b78b-4791-ad24-2c4070f26adc tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:13.215600 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4493e292-b78b-4791-ad24-2c4070f26adc tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:13.216030 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4493e292-b78b-4791-ad24-2c4070f26adc tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:13.216722 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4493e292-b78b-4791-ad24-2c4070f26adc tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:13.217180 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4493e292-b78b-4791-ad24-2c4070f26adc tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:13.217614 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4493e292-b78b-4791-ad24-2c4070f26adc tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:13.345039 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-4493e292-b78b-4791-ad24-2c4070f26adc tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:13.353636 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-4493e292-b78b-4791-ad24-2c4070f26adc tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:13.355058 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-4493e292-b78b-4791-ad24-2c4070f26adc tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:13.356199 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-4493e292-b78b-4791-ad24-2c4070f26adc tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1729 microversion: 2.20 time: 0.152782 Aug 31 19:27:13.356756 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 554/1109] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:27:13 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:27:14.379348 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e03e5882-99af-40ea-94cb-3194827564e0 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:14.380049 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-e03e5882-99af-40ea-94cb-3194827564e0 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:14.386781 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e03e5882-99af-40ea-94cb-3194827564e0 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:14.387262 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e03e5882-99af-40ea-94cb-3194827564e0 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:14.387701 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e03e5882-99af-40ea-94cb-3194827564e0 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:14.388390 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e03e5882-99af-40ea-94cb-3194827564e0 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:14.388845 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e03e5882-99af-40ea-94cb-3194827564e0 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:14.389300 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e03e5882-99af-40ea-94cb-3194827564e0 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:14.515782 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e03e5882-99af-40ea-94cb-3194827564e0 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:14.523782 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e03e5882-99af-40ea-94cb-3194827564e0 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:14.525254 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e03e5882-99af-40ea-94cb-3194827564e0 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:14.526409 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-e03e5882-99af-40ea-94cb-3194827564e0 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1729 microversion: 2.20 time: 0.151340 Aug 31 19:27:14.526973 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 556/1110] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:27:14 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:27:15.548498 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-5ddd6cbc-9856-4c93-aef0-bae6ce59c4e1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:15.549097 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-5ddd6cbc-9856-4c93-aef0-bae6ce59c4e1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:15.556074 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5ddd6cbc-9856-4c93-aef0-bae6ce59c4e1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:15.556547 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5ddd6cbc-9856-4c93-aef0-bae6ce59c4e1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:15.556972 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5ddd6cbc-9856-4c93-aef0-bae6ce59c4e1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:15.557675 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5ddd6cbc-9856-4c93-aef0-bae6ce59c4e1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:15.558119 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5ddd6cbc-9856-4c93-aef0-bae6ce59c4e1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:15.558533 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5ddd6cbc-9856-4c93-aef0-bae6ce59c4e1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:15.696087 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-5ddd6cbc-9856-4c93-aef0-bae6ce59c4e1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:15.704000 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-5ddd6cbc-9856-4c93-aef0-bae6ce59c4e1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:15.705456 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-5ddd6cbc-9856-4c93-aef0-bae6ce59c4e1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:15.706598 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-5ddd6cbc-9856-4c93-aef0-bae6ce59c4e1 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1716 microversion: 2.20 time: 0.161974 Aug 31 19:27:15.707155 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 555/1111] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:27:15 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1716 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:28:11.380301 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-40c724bc-3ec9-4d5e-ad67-fa9d4e21f303 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:11.382551 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-40c724bc-3ec9-4d5e-ad67-fa9d4e21f303 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:11.384686 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:11.385370 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:11.386285 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 19:28:11.386462 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Wed Aug 31 19:28:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56/os-volume_attachments (ip 10.222.0.65) !!! Aug 31 19:28:11.400850 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-40c724bc-3ec9-4d5e-ad67-fa9d4e21f303 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:11.401380 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-40c724bc-3ec9-4d5e-ad67-fa9d4e21f303 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:11.401846 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-40c724bc-3ec9-4d5e-ad67-fa9d4e21f303 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:11.402578 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-40c724bc-3ec9-4d5e-ad67-fa9d4e21f303 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:11.403031 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-40c724bc-3ec9-4d5e-ad67-fa9d4e21f303 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:11.403452 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-40c724bc-3ec9-4d5e-ad67-fa9d4e21f303 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:11.433672 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-40c724bc-3ec9-4d5e-ad67-fa9d4e21f303 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.057545 Aug 31 19:28:11.434900 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 557/1112] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Aug 31 19:28:11 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:28:11.496134 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-be8b858d-650f-41ff-8932-844b11f9dea6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:11.496644 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-be8b858d-650f-41ff-8932-844b11f9dea6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:11.498692 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_api:SELECT=29 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:11.499480 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=20 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:11.500371 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 19:28:11.500517 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Wed Aug 31 19:28:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 (ip 10.222.0.65) !!! Aug 31 19:28:11.501531 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 19:28:11.501678 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Wed Aug 31 19:28:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 (ip 10.222.0.65) !!! Aug 31 19:28:11.510740 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-be8b858d-650f-41ff-8932-844b11f9dea6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:11.511216 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-be8b858d-650f-41ff-8932-844b11f9dea6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:11.511639 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-be8b858d-650f-41ff-8932-844b11f9dea6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:11.512392 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-be8b858d-650f-41ff-8932-844b11f9dea6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:11.512839 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-be8b858d-650f-41ff-8932-844b11f9dea6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:11.513280 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-be8b858d-650f-41ff-8932-844b11f9dea6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:11.540291 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-be8b858d-650f-41ff-8932-844b11f9dea6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Going to try to terminate instance {{(pid=120624) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 19:28:11.616335 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-be8b858d-650f-41ff-8932-844b11f9dea6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "DELETE /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 204 len: 0 microversion: 2.20 time: 0.123829 Aug 31 19:28:11.617081 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 556/1113] 10.222.0.65 () {60 vars in 1280 bytes} [Wed Aug 31 19:28:11 2022] DELETE /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 19:28:11.625365 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-ab634220-f121-41cb-a2d2-e994fc6b526c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:11.625969 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-ab634220-f121-41cb-a2d2-e994fc6b526c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:11.631851 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ab634220-f121-41cb-a2d2-e994fc6b526c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:11.632332 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ab634220-f121-41cb-a2d2-e994fc6b526c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:11.632764 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ab634220-f121-41cb-a2d2-e994fc6b526c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:11.633467 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ab634220-f121-41cb-a2d2-e994fc6b526c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:11.633922 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ab634220-f121-41cb-a2d2-e994fc6b526c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:11.634339 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ab634220-f121-41cb-a2d2-e994fc6b526c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:11.814014 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-ab634220-f121-41cb-a2d2-e994fc6b526c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:11.822232 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-ab634220-f121-41cb-a2d2-e994fc6b526c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:11.823634 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-ab634220-f121-41cb-a2d2-e994fc6b526c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:11.825423 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-ab634220-f121-41cb-a2d2-e994fc6b526c tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1722 microversion: 2.20 time: 0.203350 Aug 31 19:28:11.825978 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 558/1114] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:28:11 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1722 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:28:12.848919 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-9d9ac453-fafd-464a-83c7-67d3056f5ea6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:12.849558 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-9d9ac453-fafd-464a-83c7-67d3056f5ea6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:12.856149 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9d9ac453-fafd-464a-83c7-67d3056f5ea6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:12.856627 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9d9ac453-fafd-464a-83c7-67d3056f5ea6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:12.857058 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9d9ac453-fafd-464a-83c7-67d3056f5ea6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:12.857783 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9d9ac453-fafd-464a-83c7-67d3056f5ea6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:12.858234 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9d9ac453-fafd-464a-83c7-67d3056f5ea6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:12.858652 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9d9ac453-fafd-464a-83c7-67d3056f5ea6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:12.985689 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-9d9ac453-fafd-464a-83c7-67d3056f5ea6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:12.993901 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-9d9ac453-fafd-464a-83c7-67d3056f5ea6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:12.995336 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-9d9ac453-fafd-464a-83c7-67d3056f5ea6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:12.997070 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-9d9ac453-fafd-464a-83c7-67d3056f5ea6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1722 microversion: 2.20 time: 0.152165 Aug 31 19:28:12.997674 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 557/1115] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:28:12 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:28:14.019541 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-bc4556a3-7004-4d24-b652-ccfaa1f06cf3 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:14.020132 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-bc4556a3-7004-4d24-b652-ccfaa1f06cf3 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:14.026818 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bc4556a3-7004-4d24-b652-ccfaa1f06cf3 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:14.027295 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bc4556a3-7004-4d24-b652-ccfaa1f06cf3 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:14.028227 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bc4556a3-7004-4d24-b652-ccfaa1f06cf3 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:14.029004 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bc4556a3-7004-4d24-b652-ccfaa1f06cf3 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:14.029791 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bc4556a3-7004-4d24-b652-ccfaa1f06cf3 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:14.030288 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bc4556a3-7004-4d24-b652-ccfaa1f06cf3 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:14.096902 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-bc4556a3-7004-4d24-b652-ccfaa1f06cf3 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:14.105460 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-bc4556a3-7004-4d24-b652-ccfaa1f06cf3 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:14.107660 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-bc4556a3-7004-4d24-b652-ccfaa1f06cf3 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:14.108973 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-bc4556a3-7004-4d24-b652-ccfaa1f06cf3 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1654 microversion: 2.20 time: 0.093418 Aug 31 19:28:14.109626 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 559/1116] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:28:14 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1654 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:28:14.617664 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-5cdd25d6-e5e7-448e-beab-96084932c8d1 req-3de2c955-7a4e-4588-b4c7-64d0a566cf0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb51cb62-2a6e-493d-94b7-48486f626d56", "name": "network-vif-deleted", "tag": "9e4f721b-2045-49c9-a2a8-2ed988b63507"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:28:14.628379 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-5cdd25d6-e5e7-448e-beab-96084932c8d1 req-3de2c955-7a4e-4588-b4c7-64d0a566cf0c service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:14.629071 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-5cdd25d6-e5e7-448e-beab-96084932c8d1 req-3de2c955-7a4e-4588-b4c7-64d0a566cf0c service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:14.629579 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-5cdd25d6-e5e7-448e-beab-96084932c8d1 req-3de2c955-7a4e-4588-b4c7-64d0a566cf0c service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:14.642905 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-5cdd25d6-e5e7-448e-beab-96084932c8d1 req-3de2c955-7a4e-4588-b4c7-64d0a566cf0c service nova] Creating event network-vif-deleted:9e4f721b-2045-49c9-a2a8-2ed988b63507 for instance eb51cb62-2a6e-493d-94b7-48486f626d56 on hv-cinder-83538 Aug 31 19:28:14.649448 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-5cdd25d6-e5e7-448e-beab-96084932c8d1 req-3de2c955-7a4e-4588-b4c7-64d0a566cf0c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035559 Aug 31 19:28:14.650254 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 558/1117] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:28:15.132111 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-2375e0c3-27f9-43ed-9557-91659381a0fd tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:15.132697 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-2375e0c3-27f9-43ed-9557-91659381a0fd tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:15.139771 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2375e0c3-27f9-43ed-9557-91659381a0fd tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:15.140263 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2375e0c3-27f9-43ed-9557-91659381a0fd tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:15.140690 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2375e0c3-27f9-43ed-9557-91659381a0fd tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:15.141431 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2375e0c3-27f9-43ed-9557-91659381a0fd tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:15.141883 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2375e0c3-27f9-43ed-9557-91659381a0fd tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:15.142309 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2375e0c3-27f9-43ed-9557-91659381a0fd tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:15.177908 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2375e0c3-27f9-43ed-9557-91659381a0fd tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:15.178621 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2375e0c3-27f9-43ed-9557-91659381a0fd tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:15.179219 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2375e0c3-27f9-43ed-9557-91659381a0fd tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:15.179851 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.objects.instance [None req-2375e0c3-27f9-43ed-9557-91659381a0fd tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lazy-loading 'fault' on Instance uuid eb51cb62-2a6e-493d-94b7-48486f626d56 {{(pid=120623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:28:15.237584 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-2375e0c3-27f9-43ed-9557-91659381a0fd tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:15.245352 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-2375e0c3-27f9-43ed-9557-91659381a0fd tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:15.246907 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-2375e0c3-27f9-43ed-9557-91659381a0fd tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '347993dd122543a684681c1a0783962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12835bbc76594286925e297e824e0d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:15.248071 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-2375e0c3-27f9-43ed-9557-91659381a0fd tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 200 len: 1370 microversion: 2.20 time: 0.120046 Aug 31 19:28:15.253399 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 560/1118] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:28:15 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 1370 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:28:16.271198 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-5b7871a9-c840-44b4-8341-12ef0867a5f6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:16.272048 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-5b7871a9-c840-44b4-8341-12ef0867a5f6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:16.278969 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5b7871a9-c840-44b4-8341-12ef0867a5f6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:16.279456 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5b7871a9-c840-44b4-8341-12ef0867a5f6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:16.279888 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5b7871a9-c840-44b4-8341-12ef0867a5f6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:16.280595 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5b7871a9-c840-44b4-8341-12ef0867a5f6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:16.281045 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5b7871a9-c840-44b4-8341-12ef0867a5f6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:16.281486 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5b7871a9-c840-44b4-8341-12ef0867a5f6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:16.295726 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.wsgi [None req-5b7871a9-c840-44b4-8341-12ef0867a5f6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] HTTP exception thrown: Instance eb51cb62-2a6e-493d-94b7-48486f626d56 could not be found. Aug 31 19:28:16.297431 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-5b7871a9-c840-44b4-8341-12ef0867a5f6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Request method failure captured: Aug 31 19:28:16.297431 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: request: GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 HTTP/1.1 Aug 31 19:28:16.297431 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept: application/json Aug 31 19:28:16.297431 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Aug 31 19:28:16.297431 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Connection: close Aug 31 19:28:16.297431 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Length: 0 Aug 31 19:28:16.297431 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Type: application/json Aug 31 19:28:16.297431 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Host: 10.222.0.65 Aug 31 19:28:16.297431 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Aug 31 19:28:16.297431 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Aug 31 19:28:16.297431 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjD7Slys0jkCkYRjhjxYgl805D58cApuFIYgk0tH0ut16LlbqCdxfGzIsbVdrGbQ_6zex4s54Z8wA9Ui-YVaZKnICUdH-MmvMh271YRMSBcfnxPw92D1VoLrvRA4y8QryNRfLfv7T9M8PgvLCNErvNzS1YxgemAjvnmIl-IF2f5EQwrxI Aug 31 19:28:16.297431 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Aug 31 19:28:16.297431 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Aug 31 19:28:16.297431 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Aug 31 19:28:16.297431 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Aug 31 19:28:16.297431 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 19:28:16.297431 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Aug 31 19:28:16.297431 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Aug 31 19:28:16.297431 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Id: 12835bbc76594286925e297e824e0d91 Aug 31 19:28:16.297431 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-64175436 Aug 31 19:28:16.297431 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Role: member,reader Aug 31 19:28:16.297431 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Roles: member,reader Aug 31 19:28:16.299229 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/12835bbc76594286925e297e824e0d91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/12835bbc76594286925e297e824e0d91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_12835bbc76594286925e297e824e0d91", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/12835bbc76594286925e297e824e0d91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:28:16.299229 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-AttachVolumeShelveTestJSON-64175436 Aug 31 19:28:16.299229 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Id: 12835bbc76594286925e297e824e0d91 Aug 31 19:28:16.299229 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-64175436 Aug 31 19:28:16.299229 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User: tempest-AttachVolumeShelveTestJSON-64175436-project Aug 31 19:28:16.299229 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Aug 31 19:28:16.299229 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Aug 31 19:28:16.299229 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Id: 347993dd122543a684681c1a0783962c Aug 31 19:28:16.299229 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-AttachVolumeShelveTestJSON-64175436-project Aug 31 19:28:16.299229 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: method: > Aug 31 19:28:16.299229 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: exception: Instance eb51cb62-2a6e-493d-94b7-48486f626d56 could not be found. Aug 31 19:28:16.299229 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: action_args: {'id': 'eb51cb62-2a6e-493d-94b7-48486f626d56'} Aug 31 19:28:16.300316 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:28:16.300316 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:28:16.300316 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:28:16.300316 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:28:16.300316 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:28:16.300316 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:28:16.300316 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:28:16.300316 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:28:16.300316 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:28:16.300316 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:28:16.300316 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb51cb62-2a6e-493d-94b7-48486f626d56 could not be found. Aug 31 19:28:16.300316 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:28:16.300316 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:28:16.300316 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:28:16.300316 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:28:16.300316 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:28:16.300316 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:28:16.300316 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:28:16.300316 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:28:16.300316 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:28:16.302159 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:28:16.302159 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:28:16.302159 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:28:16.302159 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:28:16.302159 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:28:16.302159 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:28:16.302159 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:28:16.302159 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb51cb62-2a6e-493d-94b7-48486f626d56 could not be found. Aug 31 19:28:16.302159 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:28:16.302159 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:28:16.302159 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:28:16.302159 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:28:16.302159 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:28:16.302159 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:28:16.302159 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:28:16.302159 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:28:16.302159 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb51cb62-2a6e-493d-94b7-48486f626d56 could not be found. Aug 31 19:28:16.302159 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:28:16.303945 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-5b7871a9-c840-44b4-8341-12ef0867a5f6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Returning 404 to user: Instance eb51cb62-2a6e-493d-94b7-48486f626d56 could not be found. {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:28:16.303945 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-5b7871a9-c840-44b4-8341-12ef0867a5f6 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 404 len: 111 microversion: 2.20 time: 0.032069 Aug 31 19:28:16.303945 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 559/1119] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:28:16 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 19:28:16.309770 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-ad2d31d1-33cb-42e1-9a43-7ef1d4c0555d tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '.version_select at 0x7fdb8631d280>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:16.332266 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-ad2d31d1-33cb-42e1-9a43-7ef1d4c0555d tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-795984166" status: 204 len: 0 microversion: 2.20 time: 0.026798 Aug 31 19:28:16.332848 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 561/1120] 10.222.0.65 () {60 vars in 1259 bytes} [Wed Aug 31 19:28:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-795984166 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 19:28:18.075112 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-1a28e074-d2b4-483c-8d4e-b77051664a51 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:18.075747 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-1a28e074-d2b4-483c-8d4e-b77051664a51 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:18.083187 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1a28e074-d2b4-483c-8d4e-b77051664a51 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:18.083791 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1a28e074-d2b4-483c-8d4e-b77051664a51 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:18.084222 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1a28e074-d2b4-483c-8d4e-b77051664a51 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:18.084907 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1a28e074-d2b4-483c-8d4e-b77051664a51 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:18.085377 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1a28e074-d2b4-483c-8d4e-b77051664a51 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:18.085793 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1a28e074-d2b4-483c-8d4e-b77051664a51 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:18.102360 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.wsgi [None req-1a28e074-d2b4-483c-8d4e-b77051664a51 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] HTTP exception thrown: Instance eb51cb62-2a6e-493d-94b7-48486f626d56 could not be found. Aug 31 19:28:18.103945 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-1a28e074-d2b4-483c-8d4e-b77051664a51 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Request method failure captured: Aug 31 19:28:18.103945 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: request: DELETE /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 HTTP/1.1 Aug 31 19:28:18.103945 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept: application/json Aug 31 19:28:18.103945 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Aug 31 19:28:18.103945 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Connection: close Aug 31 19:28:18.103945 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Length: 0 Aug 31 19:28:18.103945 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Type: application/json Aug 31 19:28:18.103945 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Host: 10.222.0.65 Aug 31 19:28:18.103945 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Aug 31 19:28:18.103945 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Aug 31 19:28:18.103945 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjD7Slys0jkCkYRjhjxYgl805D58cApuFIYgk0tH0ut16LlbqCdxfGzIsbVdrGbQ_6zex4s54Z8wA9Ui-YVaZKnICUdH-MmvMh271YRMSBcfnxPw92D1VoLrvRA4y8QryNRfLfv7T9M8PgvLCNErvNzS1YxgemAjvnmIl-IF2f5EQwrxI Aug 31 19:28:18.103945 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Aug 31 19:28:18.103945 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Aug 31 19:28:18.103945 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Aug 31 19:28:18.103945 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Aug 31 19:28:18.103945 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 19:28:18.103945 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Aug 31 19:28:18.103945 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Aug 31 19:28:18.103945 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Id: 12835bbc76594286925e297e824e0d91 Aug 31 19:28:18.103945 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-64175436 Aug 31 19:28:18.103945 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Role: member,reader Aug 31 19:28:18.103945 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Roles: member,reader Aug 31 19:28:18.105621 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/12835bbc76594286925e297e824e0d91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/12835bbc76594286925e297e824e0d91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_12835bbc76594286925e297e824e0d91", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/12835bbc76594286925e297e824e0d91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:28:18.105621 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-AttachVolumeShelveTestJSON-64175436 Aug 31 19:28:18.105621 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Id: 12835bbc76594286925e297e824e0d91 Aug 31 19:28:18.105621 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-64175436 Aug 31 19:28:18.105621 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User: tempest-AttachVolumeShelveTestJSON-64175436-project Aug 31 19:28:18.105621 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Aug 31 19:28:18.105621 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Aug 31 19:28:18.105621 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Id: 347993dd122543a684681c1a0783962c Aug 31 19:28:18.105621 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-AttachVolumeShelveTestJSON-64175436-project Aug 31 19:28:18.105621 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: method: > Aug 31 19:28:18.105621 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: exception: Instance eb51cb62-2a6e-493d-94b7-48486f626d56 could not be found. Aug 31 19:28:18.105621 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: action_args: {'id': 'eb51cb62-2a6e-493d-94b7-48486f626d56'} Aug 31 19:28:18.106491 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:28:18.106491 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:28:18.106491 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:28:18.106491 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:28:18.106491 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:28:18.106491 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:28:18.106491 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:28:18.106491 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:28:18.106491 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:28:18.106491 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:28:18.106491 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb51cb62-2a6e-493d-94b7-48486f626d56 could not be found. Aug 31 19:28:18.106491 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:28:18.106491 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:28:18.106491 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:28:18.106491 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:28:18.106491 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:28:18.106491 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:28:18.106491 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:28:18.106491 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:28:18.106491 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:28:18.109958 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:28:18.109958 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 19:28:18.109958 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 19:28:18.109958 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 19:28:18.109958 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 19:28:18.109958 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:28:18.109958 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:28:18.109958 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:28:18.109958 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:28:18.109958 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb51cb62-2a6e-493d-94b7-48486f626d56 could not be found. Aug 31 19:28:18.109958 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:28:18.109958 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:28:18.109958 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:28:18.109958 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:28:18.109958 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:28:18.109958 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:28:18.109958 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:28:18.109958 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:28:18.109958 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb51cb62-2a6e-493d-94b7-48486f626d56 could not be found. Aug 31 19:28:18.109958 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:28:18.111327 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-1a28e074-d2b4-483c-8d4e-b77051664a51 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Returning 404 to user: Instance eb51cb62-2a6e-493d-94b7-48486f626d56 could not be found. {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:28:18.111327 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-1a28e074-d2b4-483c-8d4e-b77051664a51 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "DELETE /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 404 len: 111 microversion: 2.20 time: 0.034302 Aug 31 19:28:18.111327 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 560/1121] 10.222.0.65 () {60 vars in 1280 bytes} [Wed Aug 31 19:28:18 2022] DELETE /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 19:28:18.115104 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-0cc446c6-b458-4269-9068-faed201a5b22 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:18.115710 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-0cc446c6-b458-4269-9068-faed201a5b22 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: eb51cb62-2a6e-493d-94b7-48486f626d56] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:18.123102 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0cc446c6-b458-4269-9068-faed201a5b22 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:18.123553 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0cc446c6-b458-4269-9068-faed201a5b22 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:18.123988 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0cc446c6-b458-4269-9068-faed201a5b22 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:18.124680 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0cc446c6-b458-4269-9068-faed201a5b22 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:18.125132 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0cc446c6-b458-4269-9068-faed201a5b22 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:18.125579 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0cc446c6-b458-4269-9068-faed201a5b22 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:18.138818 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.wsgi [None req-0cc446c6-b458-4269-9068-faed201a5b22 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] HTTP exception thrown: Instance eb51cb62-2a6e-493d-94b7-48486f626d56 could not be found. Aug 31 19:28:18.140460 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-0cc446c6-b458-4269-9068-faed201a5b22 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Request method failure captured: Aug 31 19:28:18.140460 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: request: GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 HTTP/1.1 Aug 31 19:28:18.140460 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Accept: application/json Aug 31 19:28:18.140460 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Accept-Encoding: identity Aug 31 19:28:18.140460 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Connection: close Aug 31 19:28:18.140460 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Content-Length: 0 Aug 31 19:28:18.140460 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Content-Type: application/json Aug 31 19:28:18.140460 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Host: 10.222.0.65 Aug 31 19:28:18.140460 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Openstack-System-Scope: None Aug 31 19:28:18.140460 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: User-Agent: python-urllib3/1.26.12 Aug 31 19:28:18.140460 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Auth-Token: gAAAAABjD7Slys0jkCkYRjhjxYgl805D58cApuFIYgk0tH0ut16LlbqCdxfGzIsbVdrGbQ_6zex4s54Z8wA9Ui-YVaZKnICUdH-MmvMh271YRMSBcfnxPw92D1VoLrvRA4y8QryNRfLfv7T9M8PgvLCNErvNzS1YxgemAjvnmIl-IF2f5EQwrxI Aug 31 19:28:18.140460 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Domain-Id: None Aug 31 19:28:18.140460 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Domain-Name: None Aug 31 19:28:18.140460 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Identity-Status: Confirmed Aug 31 19:28:18.140460 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Is-Admin-Project: True Aug 31 19:28:18.140460 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 19:28:18.140460 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Id: default Aug 31 19:28:18.140460 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Name: Default Aug 31 19:28:18.140460 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Id: 12835bbc76594286925e297e824e0d91 Aug 31 19:28:18.140460 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-64175436 Aug 31 19:28:18.140460 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Role: member,reader Aug 31 19:28:18.140460 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Roles: member,reader Aug 31 19:28:18.142197 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/12835bbc76594286925e297e824e0d91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/12835bbc76594286925e297e824e0d91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_12835bbc76594286925e297e824e0d91", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/12835bbc76594286925e297e824e0d91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:28:18.142197 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant: tempest-AttachVolumeShelveTestJSON-64175436 Aug 31 19:28:18.142197 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant-Id: 12835bbc76594286925e297e824e0d91 Aug 31 19:28:18.142197 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-64175436 Aug 31 19:28:18.142197 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User: tempest-AttachVolumeShelveTestJSON-64175436-project Aug 31 19:28:18.142197 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Id: default Aug 31 19:28:18.142197 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Name: Default Aug 31 19:28:18.142197 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Id: 347993dd122543a684681c1a0783962c Aug 31 19:28:18.142197 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Name: tempest-AttachVolumeShelveTestJSON-64175436-project Aug 31 19:28:18.142197 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: method: > Aug 31 19:28:18.142197 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: exception: Instance eb51cb62-2a6e-493d-94b7-48486f626d56 could not be found. Aug 31 19:28:18.142197 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: action_args: {'id': 'eb51cb62-2a6e-493d-94b7-48486f626d56'} Aug 31 19:28:18.143145 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:28:18.143145 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:28:18.143145 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:28:18.143145 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:28:18.143145 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:28:18.143145 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:28:18.143145 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:28:18.143145 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:28:18.143145 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:28:18.143145 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:28:18.143145 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb51cb62-2a6e-493d-94b7-48486f626d56 could not be found. Aug 31 19:28:18.143145 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:28:18.143145 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:28:18.143145 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:28:18.143145 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:28:18.143145 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:28:18.143145 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:28:18.143145 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:28:18.143145 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:28:18.143145 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:28:18.144793 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:28:18.144793 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:28:18.144793 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:28:18.144793 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:28:18.144793 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:28:18.144793 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:28:18.144793 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:28:18.144793 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb51cb62-2a6e-493d-94b7-48486f626d56 could not be found. Aug 31 19:28:18.144793 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:28:18.144793 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:28:18.144793 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:28:18.144793 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:28:18.144793 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:28:18.144793 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:28:18.144793 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:28:18.144793 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:28:18.144793 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb51cb62-2a6e-493d-94b7-48486f626d56 could not be found. Aug 31 19:28:18.144793 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:28:18.146271 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-0cc446c6-b458-4269-9068-faed201a5b22 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Returning 404 to user: Instance eb51cb62-2a6e-493d-94b7-48486f626d56 could not be found. {{(pid=120623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:28:18.146271 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-0cc446c6-b458-4269-9068-faed201a5b22 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56" status: 404 len: 111 microversion: 2.20 time: 0.031170 Aug 31 19:28:18.146271 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 562/1122] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:28:18 2022] GET /compute/v2.1/servers/eb51cb62-2a6e-493d-94b7-48486f626d56 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 19:28:19.286002 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-bc463769-9321-48ec-8e13-4b86faaa4df4 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:19.286521 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-bc463769-9321-48ec-8e13-4b86faaa4df4 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:19.292928 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bc463769-9321-48ec-8e13-4b86faaa4df4 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:19.293444 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bc463769-9321-48ec-8e13-4b86faaa4df4 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:19.293875 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bc463769-9321-48ec-8e13-4b86faaa4df4 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:19.294551 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bc463769-9321-48ec-8e13-4b86faaa4df4 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:19.294993 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bc463769-9321-48ec-8e13-4b86faaa4df4 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:19.295407 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bc463769-9321-48ec-8e13-4b86faaa4df4 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:19.308992 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.wsgi [None req-bc463769-9321-48ec-8e13-4b86faaa4df4 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] HTTP exception thrown: Instance 5ff90966-a8dd-41ae-848d-e155bf217b05 could not be found. Aug 31 19:28:19.311175 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-bc463769-9321-48ec-8e13-4b86faaa4df4 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Request method failure captured: Aug 31 19:28:19.311175 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: request: DELETE /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 HTTP/1.1 Aug 31 19:28:19.311175 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept: application/json Aug 31 19:28:19.311175 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Aug 31 19:28:19.311175 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Connection: close Aug 31 19:28:19.311175 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Length: 0 Aug 31 19:28:19.311175 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Type: application/json Aug 31 19:28:19.311175 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Host: 10.222.0.65 Aug 31 19:28:19.311175 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Aug 31 19:28:19.311175 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Aug 31 19:28:19.311175 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjD7Slys0jkCkYRjhjxYgl805D58cApuFIYgk0tH0ut16LlbqCdxfGzIsbVdrGbQ_6zex4s54Z8wA9Ui-YVaZKnICUdH-MmvMh271YRMSBcfnxPw92D1VoLrvRA4y8QryNRfLfv7T9M8PgvLCNErvNzS1YxgemAjvnmIl-IF2f5EQwrxI Aug 31 19:28:19.311175 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Aug 31 19:28:19.311175 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Aug 31 19:28:19.311175 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Aug 31 19:28:19.311175 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Aug 31 19:28:19.311175 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 19:28:19.311175 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Aug 31 19:28:19.311175 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Aug 31 19:28:19.311175 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Id: 12835bbc76594286925e297e824e0d91 Aug 31 19:28:19.311175 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-64175436 Aug 31 19:28:19.311175 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Role: member,reader Aug 31 19:28:19.311175 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Roles: member,reader Aug 31 19:28:19.312715 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/12835bbc76594286925e297e824e0d91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/12835bbc76594286925e297e824e0d91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_12835bbc76594286925e297e824e0d91", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/12835bbc76594286925e297e824e0d91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:28:19.312715 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-AttachVolumeShelveTestJSON-64175436 Aug 31 19:28:19.312715 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Id: 12835bbc76594286925e297e824e0d91 Aug 31 19:28:19.312715 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-64175436 Aug 31 19:28:19.312715 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User: tempest-AttachVolumeShelveTestJSON-64175436-project Aug 31 19:28:19.312715 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Aug 31 19:28:19.312715 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Aug 31 19:28:19.312715 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Id: 347993dd122543a684681c1a0783962c Aug 31 19:28:19.312715 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-AttachVolumeShelveTestJSON-64175436-project Aug 31 19:28:19.312715 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: method: > Aug 31 19:28:19.312715 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: exception: Instance 5ff90966-a8dd-41ae-848d-e155bf217b05 could not be found. Aug 31 19:28:19.312715 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: action_args: {'id': '5ff90966-a8dd-41ae-848d-e155bf217b05'} Aug 31 19:28:19.313550 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:28:19.313550 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:28:19.313550 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:28:19.313550 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:28:19.313550 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:28:19.313550 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:28:19.313550 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:28:19.313550 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:28:19.313550 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:28:19.313550 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:28:19.313550 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ff90966-a8dd-41ae-848d-e155bf217b05 could not be found. Aug 31 19:28:19.313550 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:28:19.313550 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:28:19.313550 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:28:19.313550 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:28:19.313550 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:28:19.313550 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:28:19.313550 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:28:19.313550 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:28:19.313550 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:28:19.315097 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:28:19.315097 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 19:28:19.315097 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 19:28:19.315097 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 19:28:19.315097 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 19:28:19.315097 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:28:19.315097 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:28:19.315097 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:28:19.315097 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:28:19.315097 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ff90966-a8dd-41ae-848d-e155bf217b05 could not be found. Aug 31 19:28:19.315097 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:28:19.315097 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:28:19.315097 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:28:19.315097 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:28:19.315097 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:28:19.315097 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:28:19.315097 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:28:19.315097 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:28:19.315097 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ff90966-a8dd-41ae-848d-e155bf217b05 could not be found. Aug 31 19:28:19.315097 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:28:19.317017 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-bc463769-9321-48ec-8e13-4b86faaa4df4 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Returning 404 to user: Instance 5ff90966-a8dd-41ae-848d-e155bf217b05 could not be found. {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:28:19.317017 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-bc463769-9321-48ec-8e13-4b86faaa4df4 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "DELETE /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 404 len: 111 microversion: 2.20 time: 0.030490 Aug 31 19:28:19.317017 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 561/1123] 10.222.0.65 () {60 vars in 1280 bytes} [Wed Aug 31 19:28:19 2022] DELETE /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 19:28:19.321735 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-600c2725-2c06-4ac9-89ae-85626f277300 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:19.322346 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-600c2725-2c06-4ac9-89ae-85626f277300 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] [instance: 5ff90966-a8dd-41ae-848d-e155bf217b05] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:19.329332 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-600c2725-2c06-4ac9-89ae-85626f277300 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:19.329952 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-600c2725-2c06-4ac9-89ae-85626f277300 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:19.330492 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-600c2725-2c06-4ac9-89ae-85626f277300 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:19.331186 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-600c2725-2c06-4ac9-89ae-85626f277300 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:19.331641 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-600c2725-2c06-4ac9-89ae-85626f277300 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:19.332058 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-600c2725-2c06-4ac9-89ae-85626f277300 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:19.347227 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.wsgi [None req-600c2725-2c06-4ac9-89ae-85626f277300 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] HTTP exception thrown: Instance 5ff90966-a8dd-41ae-848d-e155bf217b05 could not be found. Aug 31 19:28:19.348858 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-600c2725-2c06-4ac9-89ae-85626f277300 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Request method failure captured: Aug 31 19:28:19.348858 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: request: GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 HTTP/1.1 Aug 31 19:28:19.348858 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Accept: application/json Aug 31 19:28:19.348858 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Accept-Encoding: identity Aug 31 19:28:19.348858 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Connection: close Aug 31 19:28:19.348858 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Content-Length: 0 Aug 31 19:28:19.348858 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Content-Type: application/json Aug 31 19:28:19.348858 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Host: 10.222.0.65 Aug 31 19:28:19.348858 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Openstack-System-Scope: None Aug 31 19:28:19.348858 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: User-Agent: python-urllib3/1.26.12 Aug 31 19:28:19.348858 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Auth-Token: gAAAAABjD7Slys0jkCkYRjhjxYgl805D58cApuFIYgk0tH0ut16LlbqCdxfGzIsbVdrGbQ_6zex4s54Z8wA9Ui-YVaZKnICUdH-MmvMh271YRMSBcfnxPw92D1VoLrvRA4y8QryNRfLfv7T9M8PgvLCNErvNzS1YxgemAjvnmIl-IF2f5EQwrxI Aug 31 19:28:19.348858 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Domain-Id: None Aug 31 19:28:19.348858 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Domain-Name: None Aug 31 19:28:19.348858 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Identity-Status: Confirmed Aug 31 19:28:19.348858 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Is-Admin-Project: True Aug 31 19:28:19.348858 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 19:28:19.348858 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Id: default Aug 31 19:28:19.348858 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Name: Default Aug 31 19:28:19.348858 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Id: 12835bbc76594286925e297e824e0d91 Aug 31 19:28:19.348858 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-64175436 Aug 31 19:28:19.348858 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Role: member,reader Aug 31 19:28:19.348858 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Roles: member,reader Aug 31 19:28:19.350662 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/12835bbc76594286925e297e824e0d91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/12835bbc76594286925e297e824e0d91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_12835bbc76594286925e297e824e0d91", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/12835bbc76594286925e297e824e0d91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:28:19.350662 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant: tempest-AttachVolumeShelveTestJSON-64175436 Aug 31 19:28:19.350662 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant-Id: 12835bbc76594286925e297e824e0d91 Aug 31 19:28:19.350662 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-64175436 Aug 31 19:28:19.350662 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User: tempest-AttachVolumeShelveTestJSON-64175436-project Aug 31 19:28:19.350662 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Id: default Aug 31 19:28:19.350662 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Name: Default Aug 31 19:28:19.350662 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Id: 347993dd122543a684681c1a0783962c Aug 31 19:28:19.350662 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Name: tempest-AttachVolumeShelveTestJSON-64175436-project Aug 31 19:28:19.350662 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: method: > Aug 31 19:28:19.350662 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: exception: Instance 5ff90966-a8dd-41ae-848d-e155bf217b05 could not be found. Aug 31 19:28:19.350662 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: action_args: {'id': '5ff90966-a8dd-41ae-848d-e155bf217b05'} Aug 31 19:28:19.351663 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:28:19.351663 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:28:19.351663 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:28:19.351663 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:28:19.351663 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:28:19.351663 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:28:19.351663 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:28:19.351663 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:28:19.351663 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:28:19.351663 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:28:19.351663 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ff90966-a8dd-41ae-848d-e155bf217b05 could not be found. Aug 31 19:28:19.351663 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:28:19.351663 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:28:19.351663 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:28:19.351663 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:28:19.351663 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:28:19.351663 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:28:19.351663 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:28:19.351663 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:28:19.351663 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:28:19.353272 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:28:19.353272 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:28:19.353272 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:28:19.353272 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:28:19.353272 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:28:19.353272 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:28:19.353272 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:28:19.353272 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ff90966-a8dd-41ae-848d-e155bf217b05 could not be found. Aug 31 19:28:19.353272 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:28:19.353272 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:28:19.353272 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:28:19.353272 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:28:19.353272 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:28:19.353272 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:28:19.353272 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:28:19.353272 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:28:19.353272 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ff90966-a8dd-41ae-848d-e155bf217b05 could not be found. Aug 31 19:28:19.353272 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:28:19.354991 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-600c2725-2c06-4ac9-89ae-85626f277300 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] Returning 404 to user: Instance 5ff90966-a8dd-41ae-848d-e155bf217b05 could not be found. {{(pid=120623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:28:19.354991 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-600c2725-2c06-4ac9-89ae-85626f277300 tempest-AttachVolumeShelveTestJSON-64175436 tempest-AttachVolumeShelveTestJSON-64175436-project] 10.222.0.65 "GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05" status: 404 len: 111 microversion: 2.20 time: 0.032392 Aug 31 19:28:19.354991 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 563/1124] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 19:28:19 2022] GET /compute/v2.1/servers/5ff90966-a8dd-41ae-848d-e155bf217b05 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 19:28:27.483694 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-4c1df4a7-e43e-45c6-9eac-042d713f8e70 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Action: 'create', calling method: .version_select at 0x7fdb871e8a60>, body: {"keypair": {"name": "tempest-keypair-119625968", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILM8/t0VwAVNIgjJQGR5l8usGRYLePw1qEEP7fqAoac7G3Qp1/rTz9wem0x2CjJsaNI3BRm9dHxpa+b/nrJEWg8V54EqShCwEbvi7wB9dwltGOhAwUKVJjMi5PVtSpEtg=="}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:28:27.498991 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-4c1df4a7-e43e-45c6-9eac-042d713f8e70 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Getting quotas for project 548f21e0f1dc4c2da5e743e6d01154a3. Resources: {'key_pairs'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:28:27.502795 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-4c1df4a7-e43e-45c6-9eac-042d713f8e70 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Getting quotas for user 745deef0124c480cb48ebe7efaea546a and project 548f21e0f1dc4c2da5e743e6d01154a3. Resources: {'key_pairs'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:28:27.542426 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-4c1df4a7-e43e-45c6-9eac-042d713f8e70 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.175965 Aug 31 19:28:27.543249 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 562/1125] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Aug 31 19:28:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:28:28.861086 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-23d0a99b-d7be-4002-8eaa-2a544311d8d9 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-98926908", "imageRef": "f4f2ae76-bacc-4449-881b-f697e1eeec66", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "761adef9-b54a-4114-adb2-cf72eab21f9d"}], "security_groups": [{"name": "tempest-securitygroup--2060550139"}], "key_name": "tempest-keypair-119625968", "user_data": "}} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:28:28.972277 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.network.neutron [None req-23d0a99b-d7be-4002-8eaa-2a544311d8d9 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] validate_networks() for [('761adef9-b54a-4114-adb2-cf72eab21f9d', None, None, None, None, None)] {{(pid=120623) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:28:29.342226 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=30 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:29.435421 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-23d0a99b-d7be-4002-8eaa-2a544311d8d9 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Flavor limits 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:28:29.435958 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-23d0a99b-d7be-4002-8eaa-2a544311d8d9 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Image limits 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:28:29.436540 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-23d0a99b-d7be-4002-8eaa-2a544311d8d9 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Flavor pref 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:28:29.437022 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-23d0a99b-d7be-4002-8eaa-2a544311d8d9 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Image pref 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:28:29.437546 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-23d0a99b-d7be-4002-8eaa-2a544311d8d9 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:28:29.446412 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-23d0a99b-d7be-4002-8eaa-2a544311d8d9 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:29.447086 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-23d0a99b-d7be-4002-8eaa-2a544311d8d9 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:29.447592 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-23d0a99b-d7be-4002-8eaa-2a544311d8d9 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:29.448421 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-23d0a99b-d7be-4002-8eaa-2a544311d8d9 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:29.448948 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-23d0a99b-d7be-4002-8eaa-2a544311d8d9 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:29.449472 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-23d0a99b-d7be-4002-8eaa-2a544311d8d9 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:29.468454 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.quota [None req-23d0a99b-d7be-4002-8eaa-2a544311d8d9 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Getting quotas for project 548f21e0f1dc4c2da5e743e6d01154a3. Resources: {'instances', 'cores', 'ram'} {{(pid=120623) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:28:29.472505 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.quota [None req-23d0a99b-d7be-4002-8eaa-2a544311d8d9 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Getting quotas for user 745deef0124c480cb48ebe7efaea546a and project 548f21e0f1dc4c2da5e743e6d01154a3. Resources: {'instances', 'cores', 'ram'} {{(pid=120623) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:28:29.483445 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-23d0a99b-d7be-4002-8eaa-2a544311d8d9 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Going to run 1 instances... {{(pid=120623) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:28:29.485694 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-23d0a99b-d7be-4002-8eaa-2a544311d8d9 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f4f2ae76-bacc-4449-881b-f697e1eeec66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120623) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:28:29.533490 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-23d0a99b-d7be-4002-8eaa-2a544311d8d9 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.676553 Aug 31 19:28:29.534447 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 564/1126] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 31 19:28:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 19:28:29.542274 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:29.546875 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-203d607b-a4b6-427f-bc54-f06b13b8bef1 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:29.548007 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-203d607b-a4b6-427f-bc54-f06b13b8bef1 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:29.613689 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-203d607b-a4b6-427f-bc54-f06b13b8bef1 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745deef0124c480cb48ebe7efaea546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f21e0f1dc4c2da5e743e6d01154a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:29.621291 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-203d607b-a4b6-427f-bc54-f06b13b8bef1 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065" status: 200 len: 1235 microversion: 2.1 time: 0.080261 Aug 31 19:28:29.622779 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 563/1127] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:29 2022] GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065 => generated 1235 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:28:30.643587 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-9aa6a329-35f3-4004-aa73-115a7e361066 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:30.644239 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-9aa6a329-35f3-4004-aa73-115a7e361066 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:30.650499 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9aa6a329-35f3-4004-aa73-115a7e361066 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:30.650985 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9aa6a329-35f3-4004-aa73-115a7e361066 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:30.651462 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9aa6a329-35f3-4004-aa73-115a7e361066 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:30.652097 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9aa6a329-35f3-4004-aa73-115a7e361066 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:30.652985 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9aa6a329-35f3-4004-aa73-115a7e361066 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:30.654009 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9aa6a329-35f3-4004-aa73-115a7e361066 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:30.723795 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-9aa6a329-35f3-4004-aa73-115a7e361066 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745deef0124c480cb48ebe7efaea546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f21e0f1dc4c2da5e743e6d01154a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:30.732877 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-9aa6a329-35f3-4004-aa73-115a7e361066 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065" status: 200 len: 1287 microversion: 2.1 time: 0.092793 Aug 31 19:28:30.734094 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 565/1128] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:30 2022] GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065 => generated 1287 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:28:31.755020 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-0cb0520f-ef21-4c94-b49c-f5efe50a2da4 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:31.755648 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-0cb0520f-ef21-4c94-b49c-f5efe50a2da4 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:31.762002 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0cb0520f-ef21-4c94-b49c-f5efe50a2da4 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:31.762486 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0cb0520f-ef21-4c94-b49c-f5efe50a2da4 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:31.762974 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0cb0520f-ef21-4c94-b49c-f5efe50a2da4 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:31.763655 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0cb0520f-ef21-4c94-b49c-f5efe50a2da4 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:31.764096 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0cb0520f-ef21-4c94-b49c-f5efe50a2da4 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:31.764517 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0cb0520f-ef21-4c94-b49c-f5efe50a2da4 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:32.004075 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-0cb0520f-ef21-4c94-b49c-f5efe50a2da4 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745deef0124c480cb48ebe7efaea546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f21e0f1dc4c2da5e743e6d01154a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:32.011817 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-0cb0520f-ef21-4c94-b49c-f5efe50a2da4 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065" status: 200 len: 1361 microversion: 2.1 time: 0.260597 Aug 31 19:28:32.012349 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 564/1129] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:31 2022] GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065 => generated 1361 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:28:32.320129 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-bc3896f7-b343-4b2f-861c-9ee251dd3578 req-e40f992a-0f6d-416c-b4a5-f8d6990be825 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b81447ec-0b34-4911-b4f7-44ade9239065", "tag": "176aa081-1ee6-4420-929f-cb6a296a89b0"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:28:32.333409 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-bc3896f7-b343-4b2f-861c-9ee251dd3578 req-e40f992a-0f6d-416c-b4a5-f8d6990be825 service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:32.333979 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-bc3896f7-b343-4b2f-861c-9ee251dd3578 req-e40f992a-0f6d-416c-b4a5-f8d6990be825 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:32.334415 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-bc3896f7-b343-4b2f-861c-9ee251dd3578 req-e40f992a-0f6d-416c-b4a5-f8d6990be825 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:32.346349 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-bc3896f7-b343-4b2f-861c-9ee251dd3578 req-e40f992a-0f6d-416c-b4a5-f8d6990be825 service nova] Creating event network-changed:176aa081-1ee6-4420-929f-cb6a296a89b0 for instance b81447ec-0b34-4911-b4f7-44ade9239065 on hv-cinder-83538 Aug 31 19:28:32.352695 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-bc3896f7-b343-4b2f-861c-9ee251dd3578 req-e40f992a-0f6d-416c-b4a5-f8d6990be825 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037012 Aug 31 19:28:32.353468 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 566/1130] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:28:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:28:33.031976 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-f9996743-a4c9-4776-825e-812879f263e4 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:33.032585 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-f9996743-a4c9-4776-825e-812879f263e4 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:33.039131 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f9996743-a4c9-4776-825e-812879f263e4 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:33.039606 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f9996743-a4c9-4776-825e-812879f263e4 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:33.040053 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f9996743-a4c9-4776-825e-812879f263e4 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:33.040735 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f9996743-a4c9-4776-825e-812879f263e4 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:33.041179 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f9996743-a4c9-4776-825e-812879f263e4 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:33.041616 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f9996743-a4c9-4776-825e-812879f263e4 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:33.171776 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-f9996743-a4c9-4776-825e-812879f263e4 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745deef0124c480cb48ebe7efaea546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f21e0f1dc4c2da5e743e6d01154a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:33.181030 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-f9996743-a4c9-4776-825e-812879f263e4 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065" status: 200 len: 1361 microversion: 2.1 time: 0.151411 Aug 31 19:28:33.181681 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 565/1131] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:33 2022] GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:28:34.203571 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-6e02f9b6-8d6c-40c6-9342-1a1101cc8ad9 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:34.204269 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-6e02f9b6-8d6c-40c6-9342-1a1101cc8ad9 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:34.210970 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6e02f9b6-8d6c-40c6-9342-1a1101cc8ad9 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:34.211458 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6e02f9b6-8d6c-40c6-9342-1a1101cc8ad9 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:34.211895 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6e02f9b6-8d6c-40c6-9342-1a1101cc8ad9 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:34.212586 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6e02f9b6-8d6c-40c6-9342-1a1101cc8ad9 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:34.213040 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6e02f9b6-8d6c-40c6-9342-1a1101cc8ad9 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:34.213494 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6e02f9b6-8d6c-40c6-9342-1a1101cc8ad9 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:34.344630 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-6e02f9b6-8d6c-40c6-9342-1a1101cc8ad9 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745deef0124c480cb48ebe7efaea546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f21e0f1dc4c2da5e743e6d01154a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:34.352346 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-6e02f9b6-8d6c-40c6-9342-1a1101cc8ad9 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065" status: 200 len: 1361 microversion: 2.1 time: 0.153587 Aug 31 19:28:34.352905 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 567/1132] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:34 2022] GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:28:35.373288 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-723ea677-ae41-4781-8c87-5c4edb74552b tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:35.373904 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-723ea677-ae41-4781-8c87-5c4edb74552b tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:35.380390 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-723ea677-ae41-4781-8c87-5c4edb74552b tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:35.380872 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-723ea677-ae41-4781-8c87-5c4edb74552b tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:35.381329 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-723ea677-ae41-4781-8c87-5c4edb74552b tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:35.382024 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-723ea677-ae41-4781-8c87-5c4edb74552b tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:35.382471 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-723ea677-ae41-4781-8c87-5c4edb74552b tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:35.382889 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-723ea677-ae41-4781-8c87-5c4edb74552b tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:35.582717 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-723ea677-ae41-4781-8c87-5c4edb74552b tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745deef0124c480cb48ebe7efaea546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f21e0f1dc4c2da5e743e6d01154a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:35.590341 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-723ea677-ae41-4781-8c87-5c4edb74552b tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065" status: 200 len: 1361 microversion: 2.1 time: 0.221539 Aug 31 19:28:35.591468 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 566/1133] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:35 2022] GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065 => generated 1361 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:28:36.612135 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-a1b1213e-d5ed-460a-9d0a-90f2f467eea2 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:36.612734 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-a1b1213e-d5ed-460a-9d0a-90f2f467eea2 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:36.619122 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a1b1213e-d5ed-460a-9d0a-90f2f467eea2 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:36.619599 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a1b1213e-d5ed-460a-9d0a-90f2f467eea2 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:36.620022 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a1b1213e-d5ed-460a-9d0a-90f2f467eea2 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:36.620724 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a1b1213e-d5ed-460a-9d0a-90f2f467eea2 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:36.621167 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a1b1213e-d5ed-460a-9d0a-90f2f467eea2 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:36.621612 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a1b1213e-d5ed-460a-9d0a-90f2f467eea2 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:36.753564 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-a1b1213e-d5ed-460a-9d0a-90f2f467eea2 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745deef0124c480cb48ebe7efaea546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f21e0f1dc4c2da5e743e6d01154a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:36.761352 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-a1b1213e-d5ed-460a-9d0a-90f2f467eea2 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065" status: 200 len: 1361 microversion: 2.1 time: 0.153010 Aug 31 19:28:36.761914 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 568/1134] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:36 2022] GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:28:37.781743 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-821a2f5e-1826-446a-a4d4-4721f616fced tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:37.782347 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-821a2f5e-1826-446a-a4d4-4721f616fced tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:37.788853 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-821a2f5e-1826-446a-a4d4-4721f616fced tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:37.789364 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-821a2f5e-1826-446a-a4d4-4721f616fced tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:37.789795 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-821a2f5e-1826-446a-a4d4-4721f616fced tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:37.790473 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-821a2f5e-1826-446a-a4d4-4721f616fced tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:37.790921 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-821a2f5e-1826-446a-a4d4-4721f616fced tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:37.791336 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-821a2f5e-1826-446a-a4d4-4721f616fced tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:37.917986 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-821a2f5e-1826-446a-a4d4-4721f616fced tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745deef0124c480cb48ebe7efaea546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f21e0f1dc4c2da5e743e6d01154a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:37.925510 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-821a2f5e-1826-446a-a4d4-4721f616fced tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065" status: 200 len: 1361 microversion: 2.1 time: 0.147690 Aug 31 19:28:37.926084 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 567/1135] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:37 2022] GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065 => generated 1361 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:28:38.946401 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-19fc7b6f-1966-4df1-a2fd-4d5ac5fc881e tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:38.946996 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-19fc7b6f-1966-4df1-a2fd-4d5ac5fc881e tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:38.953869 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-19fc7b6f-1966-4df1-a2fd-4d5ac5fc881e tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:38.954358 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-19fc7b6f-1966-4df1-a2fd-4d5ac5fc881e tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:38.956226 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-19fc7b6f-1966-4df1-a2fd-4d5ac5fc881e tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:38.956226 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-19fc7b6f-1966-4df1-a2fd-4d5ac5fc881e tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:38.956597 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-19fc7b6f-1966-4df1-a2fd-4d5ac5fc881e tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:38.957038 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-19fc7b6f-1966-4df1-a2fd-4d5ac5fc881e tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:39.090358 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-19fc7b6f-1966-4df1-a2fd-4d5ac5fc881e tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745deef0124c480cb48ebe7efaea546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f21e0f1dc4c2da5e743e6d01154a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:39.098717 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-19fc7b6f-1966-4df1-a2fd-4d5ac5fc881e tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065" status: 200 len: 1361 microversion: 2.1 time: 0.156165 Aug 31 19:28:39.099508 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 569/1136] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:38 2022] GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:28:39.177595 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-03059322-a5bc-40f3-9b66-f109eae79c18 req-9c47f5b4-ec62-43a4-bfc6-6f2c5ac117c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b81447ec-0b34-4911-b4f7-44ade9239065", "name": "network-vif-plugged", "status": "completed", "tag": "176aa081-1ee6-4420-929f-cb6a296a89b0"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:28:39.188419 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-03059322-a5bc-40f3-9b66-f109eae79c18 req-9c47f5b4-ec62-43a4-bfc6-6f2c5ac117c1 service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:39.188970 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-03059322-a5bc-40f3-9b66-f109eae79c18 req-9c47f5b4-ec62-43a4-bfc6-6f2c5ac117c1 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:39.190304 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-03059322-a5bc-40f3-9b66-f109eae79c18 req-9c47f5b4-ec62-43a4-bfc6-6f2c5ac117c1 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:39.202794 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-03059322-a5bc-40f3-9b66-f109eae79c18 req-9c47f5b4-ec62-43a4-bfc6-6f2c5ac117c1 service nova] Creating event network-vif-plugged:176aa081-1ee6-4420-929f-cb6a296a89b0 for instance b81447ec-0b34-4911-b4f7-44ade9239065 on hv-cinder-83538 Aug 31 19:28:39.208204 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-03059322-a5bc-40f3-9b66-f109eae79c18 req-9c47f5b4-ec62-43a4-bfc6-6f2c5ac117c1 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034316 Aug 31 19:28:39.209439 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 568/1137] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:28:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:28:40.119961 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-f805353a-db99-4e7a-ae73-fa9a59c37226 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:40.120738 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-f805353a-db99-4e7a-ae73-fa9a59c37226 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:40.122768 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell0:SELECT=2 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:40.123440 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell0:SELECT=6 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:40.130159 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f805353a-db99-4e7a-ae73-fa9a59c37226 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:40.130619 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f805353a-db99-4e7a-ae73-fa9a59c37226 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:40.131047 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f805353a-db99-4e7a-ae73-fa9a59c37226 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:40.131729 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f805353a-db99-4e7a-ae73-fa9a59c37226 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:40.132174 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f805353a-db99-4e7a-ae73-fa9a59c37226 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:40.132591 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f805353a-db99-4e7a-ae73-fa9a59c37226 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:40.266919 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-f805353a-db99-4e7a-ae73-fa9a59c37226 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745deef0124c480cb48ebe7efaea546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f21e0f1dc4c2da5e743e6d01154a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:40.274549 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-f805353a-db99-4e7a-ae73-fa9a59c37226 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065" status: 200 len: 1361 microversion: 2.1 time: 0.158530 Aug 31 19:28:40.275107 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 570/1138] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:40 2022] GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065 => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:28:41.295958 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-ec94aadd-c6ec-4dcf-9f8b-1a3878e37f28 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:41.296646 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-ec94aadd-c6ec-4dcf-9f8b-1a3878e37f28 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:41.298607 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell0:SELECT=6 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:41.304779 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ec94aadd-c6ec-4dcf-9f8b-1a3878e37f28 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:41.305274 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ec94aadd-c6ec-4dcf-9f8b-1a3878e37f28 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:41.305698 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ec94aadd-c6ec-4dcf-9f8b-1a3878e37f28 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:41.306372 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ec94aadd-c6ec-4dcf-9f8b-1a3878e37f28 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:41.306810 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ec94aadd-c6ec-4dcf-9f8b-1a3878e37f28 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:41.307220 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ec94aadd-c6ec-4dcf-9f8b-1a3878e37f28 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:41.440627 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-ec94aadd-c6ec-4dcf-9f8b-1a3878e37f28 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745deef0124c480cb48ebe7efaea546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f21e0f1dc4c2da5e743e6d01154a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:41.448341 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-ec94aadd-c6ec-4dcf-9f8b-1a3878e37f28 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065" status: 200 len: 1547 microversion: 2.1 time: 0.157082 Aug 31 19:28:41.448843 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 569/1139] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:41 2022] GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065 => generated 1547 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:28:41.468941 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-bc8cb51e-8878-463d-94aa-82853589be9a tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:41.469522 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-bc8cb51e-8878-463d-94aa-82853589be9a tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:41.471820 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:41.476972 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bc8cb51e-8878-463d-94aa-82853589be9a tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:41.477476 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bc8cb51e-8878-463d-94aa-82853589be9a tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:41.477909 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bc8cb51e-8878-463d-94aa-82853589be9a tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:41.478600 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bc8cb51e-8878-463d-94aa-82853589be9a tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:41.479054 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bc8cb51e-8878-463d-94aa-82853589be9a tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:41.479480 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bc8cb51e-8878-463d-94aa-82853589be9a tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:41.556181 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-bc8cb51e-8878-463d-94aa-82853589be9a tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091876 Aug 31 19:28:41.556771 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 571/1140] 10.222.0.65 () {58 vars in 1275 bytes} [Wed Aug 31 19:28:41 2022] GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:28:42.775295 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-f59e617d-0b1b-4546-b8ba-eaebe4f3da33 req-87dae06a-17c6-4e11-a5d0-0454e04bb4b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b81447ec-0b34-4911-b4f7-44ade9239065", "tag": "176aa081-1ee6-4420-929f-cb6a296a89b0"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:28:42.780559 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:42.786396 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-f59e617d-0b1b-4546-b8ba-eaebe4f3da33 req-87dae06a-17c6-4e11-a5d0-0454e04bb4b1 service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:42.786860 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-f59e617d-0b1b-4546-b8ba-eaebe4f3da33 req-87dae06a-17c6-4e11-a5d0-0454e04bb4b1 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:42.787279 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-f59e617d-0b1b-4546-b8ba-eaebe4f3da33 req-87dae06a-17c6-4e11-a5d0-0454e04bb4b1 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:42.800051 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-f59e617d-0b1b-4546-b8ba-eaebe4f3da33 req-87dae06a-17c6-4e11-a5d0-0454e04bb4b1 service nova] Creating event network-changed:176aa081-1ee6-4420-929f-cb6a296a89b0 for instance b81447ec-0b34-4911-b4f7-44ade9239065 on hv-cinder-83538 Aug 31 19:28:42.805063 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-f59e617d-0b1b-4546-b8ba-eaebe4f3da33 req-87dae06a-17c6-4e11-a5d0-0454e04bb4b1 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087707 Aug 31 19:28:42.806002 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 570/1141] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:29:57.723642 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=1 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:57.724371 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=38 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:57.730641 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-0590d957-f136-4def-b0fa-e226fe555cb9 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:57.731124 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-0590d957-f136-4def-b0fa-e226fe555cb9 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:57.737285 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0590d957-f136-4def-b0fa-e226fe555cb9 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:57.737769 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0590d957-f136-4def-b0fa-e226fe555cb9 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:57.738200 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0590d957-f136-4def-b0fa-e226fe555cb9 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:57.738890 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0590d957-f136-4def-b0fa-e226fe555cb9 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:57.739342 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0590d957-f136-4def-b0fa-e226fe555cb9 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:57.739767 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0590d957-f136-4def-b0fa-e226fe555cb9 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:57.763477 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-0590d957-f136-4def-b0fa-e226fe555cb9 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065/ips" status: 200 len: 146 microversion: 2.1 time: 0.041834 Aug 31 19:29:57.764031 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 572/1142] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Aug 31 19:29:57 2022] GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065/ips => generated 146 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:29:59.797871 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=34 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:59.798595 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_api:SELECT=1 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:59.804422 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-fec79469-6d00-407f-b661-2923cca9e373 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "95380107-cce7-40c0-8bf3-b655491d7fcd"}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:29:59.806834 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-fec79469-6d00-407f-b661-2923cca9e373 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:59.814009 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fec79469-6d00-407f-b661-2923cca9e373 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:59.814490 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fec79469-6d00-407f-b661-2923cca9e373 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:59.814926 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fec79469-6d00-407f-b661-2923cca9e373 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:59.815622 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fec79469-6d00-407f-b661-2923cca9e373 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:59.816089 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fec79469-6d00-407f-b661-2923cca9e373 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:59.816497 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fec79469-6d00-407f-b661-2923cca9e373 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:00.068914 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-fec79469-6d00-407f-b661-2923cca9e373 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "POST /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272770 Aug 31 19:30:00.069697 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 571/1143] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 31 19:29:59 2022] POST /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:30:07.583439 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-16bcf04e-9c02-450b-8005-5958de469202 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:30:07.590685 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-16bcf04e-9c02-450b-8005-5958de469202 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:07.591163 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-16bcf04e-9c02-450b-8005-5958de469202 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:07.591588 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-16bcf04e-9c02-450b-8005-5958de469202 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:07.649648 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-16bcf04e-9c02-450b-8005-5958de469202 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Going to try to stop instance {{(pid=120623) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 31 19:30:07.691882 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-16bcf04e-9c02-450b-8005-5958de469202 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "POST /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065/action" status: 202 len: 0 microversion: 2.1 time: 0.112691 Aug 31 19:30:07.692472 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 573/1144] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 31 19:30:07 2022] POST /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:30:07.706265 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-df0529f7-6d71-49c0-9aee-b5428a7a305b tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:07.706968 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-df0529f7-6d71-49c0-9aee-b5428a7a305b tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:07.714710 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-df0529f7-6d71-49c0-9aee-b5428a7a305b tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:07.715187 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-df0529f7-6d71-49c0-9aee-b5428a7a305b tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:07.715639 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-df0529f7-6d71-49c0-9aee-b5428a7a305b tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:07.716329 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-df0529f7-6d71-49c0-9aee-b5428a7a305b tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:07.716767 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-df0529f7-6d71-49c0-9aee-b5428a7a305b tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:07.717462 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-df0529f7-6d71-49c0-9aee-b5428a7a305b tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:07.852647 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-df0529f7-6d71-49c0-9aee-b5428a7a305b tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745deef0124c480cb48ebe7efaea546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f21e0f1dc4c2da5e743e6d01154a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:07.861376 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-df0529f7-6d71-49c0-9aee-b5428a7a305b tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065" status: 200 len: 1722 microversion: 2.1 time: 0.164483 Aug 31 19:30:07.862033 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 572/1145] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:30:07 2022] GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:30:08.883891 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-10e7f729-f665-4840-8585-d3e3e54de4f2 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:08.884590 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-10e7f729-f665-4840-8585-d3e3e54de4f2 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:08.891426 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-10e7f729-f665-4840-8585-d3e3e54de4f2 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:08.891910 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-10e7f729-f665-4840-8585-d3e3e54de4f2 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:08.892343 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-10e7f729-f665-4840-8585-d3e3e54de4f2 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:08.893032 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-10e7f729-f665-4840-8585-d3e3e54de4f2 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:08.893515 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-10e7f729-f665-4840-8585-d3e3e54de4f2 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:08.893941 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-10e7f729-f665-4840-8585-d3e3e54de4f2 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:09.024311 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-10e7f729-f665-4840-8585-d3e3e54de4f2 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745deef0124c480cb48ebe7efaea546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f21e0f1dc4c2da5e743e6d01154a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:09.032757 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-10e7f729-f665-4840-8585-d3e3e54de4f2 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065" status: 200 len: 1722 microversion: 2.1 time: 0.153744 Aug 31 19:30:09.033338 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 574/1146] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:30:08 2022] GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:30:10.053729 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-0932c738-356a-40a6-a32f-e787392cc9f0 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:10.054331 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-0932c738-356a-40a6-a32f-e787392cc9f0 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:10.061507 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0932c738-356a-40a6-a32f-e787392cc9f0 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:10.062013 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0932c738-356a-40a6-a32f-e787392cc9f0 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:10.062447 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0932c738-356a-40a6-a32f-e787392cc9f0 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:10.063136 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0932c738-356a-40a6-a32f-e787392cc9f0 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:10.063586 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0932c738-356a-40a6-a32f-e787392cc9f0 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:10.064006 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0932c738-356a-40a6-a32f-e787392cc9f0 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:10.190289 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-0932c738-356a-40a6-a32f-e787392cc9f0 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745deef0124c480cb48ebe7efaea546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f21e0f1dc4c2da5e743e6d01154a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:10.198710 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-0932c738-356a-40a6-a32f-e787392cc9f0 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065" status: 200 len: 1722 microversion: 2.1 time: 0.148833 Aug 31 19:30:10.199285 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 573/1147] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:30:10 2022] GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:30:11.220190 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-94312434-98b7-4b4e-83d1-00923ee3f6b2 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:11.220790 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-94312434-98b7-4b4e-83d1-00923ee3f6b2 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:11.227159 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-94312434-98b7-4b4e-83d1-00923ee3f6b2 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:11.227633 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-94312434-98b7-4b4e-83d1-00923ee3f6b2 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:11.228056 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-94312434-98b7-4b4e-83d1-00923ee3f6b2 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:11.228730 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-94312434-98b7-4b4e-83d1-00923ee3f6b2 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:11.229239 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-94312434-98b7-4b4e-83d1-00923ee3f6b2 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:11.229675 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-94312434-98b7-4b4e-83d1-00923ee3f6b2 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:11.363133 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-94312434-98b7-4b4e-83d1-00923ee3f6b2 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745deef0124c480cb48ebe7efaea546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f21e0f1dc4c2da5e743e6d01154a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:11.374312 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-94312434-98b7-4b4e-83d1-00923ee3f6b2 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065" status: 200 len: 1722 microversion: 2.1 time: 0.158129 Aug 31 19:30:11.374904 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 575/1148] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:30:11 2022] GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:30:12.395734 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-9ed3e263-c683-45ca-9172-9a737ed79fc3 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:12.396361 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-9ed3e263-c683-45ca-9172-9a737ed79fc3 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:12.402838 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9ed3e263-c683-45ca-9172-9a737ed79fc3 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:12.403348 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9ed3e263-c683-45ca-9172-9a737ed79fc3 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:12.403776 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9ed3e263-c683-45ca-9172-9a737ed79fc3 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:12.404454 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9ed3e263-c683-45ca-9172-9a737ed79fc3 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:12.404925 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9ed3e263-c683-45ca-9172-9a737ed79fc3 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:12.405379 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9ed3e263-c683-45ca-9172-9a737ed79fc3 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:12.541988 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-9ed3e263-c683-45ca-9172-9a737ed79fc3 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745deef0124c480cb48ebe7efaea546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f21e0f1dc4c2da5e743e6d01154a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:12.550294 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-9ed3e263-c683-45ca-9172-9a737ed79fc3 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065" status: 200 len: 1722 microversion: 2.1 time: 0.158370 Aug 31 19:30:12.550865 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 574/1149] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:30:12 2022] GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:30:13.571552 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-2bba920a-9705-42ee-9f84-60216596bf91 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:13.572173 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-2bba920a-9705-42ee-9f84-60216596bf91 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:13.579480 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2bba920a-9705-42ee-9f84-60216596bf91 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:13.579956 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2bba920a-9705-42ee-9f84-60216596bf91 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:13.580457 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2bba920a-9705-42ee-9f84-60216596bf91 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:13.581133 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2bba920a-9705-42ee-9f84-60216596bf91 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:13.581605 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2bba920a-9705-42ee-9f84-60216596bf91 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:13.582017 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2bba920a-9705-42ee-9f84-60216596bf91 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:13.712735 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-2bba920a-9705-42ee-9f84-60216596bf91 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745deef0124c480cb48ebe7efaea546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f21e0f1dc4c2da5e743e6d01154a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:13.722403 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-2bba920a-9705-42ee-9f84-60216596bf91 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065" status: 200 len: 1722 microversion: 2.1 time: 0.153987 Aug 31 19:30:13.723613 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 576/1150] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:30:13 2022] GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:30:14.744322 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-4052ccdf-9f53-470d-8145-fa1c56fccb8b tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:14.745738 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-4052ccdf-9f53-470d-8145-fa1c56fccb8b tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:14.752257 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4052ccdf-9f53-470d-8145-fa1c56fccb8b tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:14.752831 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4052ccdf-9f53-470d-8145-fa1c56fccb8b tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:14.753308 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4052ccdf-9f53-470d-8145-fa1c56fccb8b tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:14.753999 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4052ccdf-9f53-470d-8145-fa1c56fccb8b tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:14.754490 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4052ccdf-9f53-470d-8145-fa1c56fccb8b tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:14.754939 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4052ccdf-9f53-470d-8145-fa1c56fccb8b tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:14.895515 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-4052ccdf-9f53-470d-8145-fa1c56fccb8b tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745deef0124c480cb48ebe7efaea546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f21e0f1dc4c2da5e743e6d01154a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:14.904164 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-4052ccdf-9f53-470d-8145-fa1c56fccb8b tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065" status: 200 len: 1722 microversion: 2.1 time: 0.163818 Aug 31 19:30:14.904728 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 575/1151] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:30:14 2022] GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:30:15.925880 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-db1ea8a3-51f1-41ae-bd0e-6644fc1deef6 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:15.926491 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-db1ea8a3-51f1-41ae-bd0e-6644fc1deef6 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:15.933389 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-db1ea8a3-51f1-41ae-bd0e-6644fc1deef6 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:15.933872 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-db1ea8a3-51f1-41ae-bd0e-6644fc1deef6 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:15.934305 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-db1ea8a3-51f1-41ae-bd0e-6644fc1deef6 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:15.934992 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-db1ea8a3-51f1-41ae-bd0e-6644fc1deef6 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:15.935481 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-db1ea8a3-51f1-41ae-bd0e-6644fc1deef6 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:15.935905 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-db1ea8a3-51f1-41ae-bd0e-6644fc1deef6 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:16.067748 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-db1ea8a3-51f1-41ae-bd0e-6644fc1deef6 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745deef0124c480cb48ebe7efaea546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f21e0f1dc4c2da5e743e6d01154a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:16.075871 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-db1ea8a3-51f1-41ae-bd0e-6644fc1deef6 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065" status: 200 len: 1722 microversion: 2.1 time: 0.153877 Aug 31 19:30:16.076433 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 577/1152] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:30:15 2022] GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:30:17.096214 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-c63dc37a-cd25-480f-b4f5-9fb9b532961a tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:17.096810 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-c63dc37a-cd25-480f-b4f5-9fb9b532961a tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:17.103108 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c63dc37a-cd25-480f-b4f5-9fb9b532961a tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:17.103582 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c63dc37a-cd25-480f-b4f5-9fb9b532961a tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:17.104050 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c63dc37a-cd25-480f-b4f5-9fb9b532961a tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:17.104720 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c63dc37a-cd25-480f-b4f5-9fb9b532961a tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:17.105160 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c63dc37a-cd25-480f-b4f5-9fb9b532961a tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:17.105597 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c63dc37a-cd25-480f-b4f5-9fb9b532961a tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:17.232804 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-c63dc37a-cd25-480f-b4f5-9fb9b532961a tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745deef0124c480cb48ebe7efaea546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f21e0f1dc4c2da5e743e6d01154a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:17.241130 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-c63dc37a-cd25-480f-b4f5-9fb9b532961a tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065" status: 200 len: 1722 microversion: 2.1 time: 0.149222 Aug 31 19:30:17.241739 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 576/1153] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:30:17 2022] GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:30:18.263233 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-18772f19-990c-425a-97d4-165ab444f142 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:18.263851 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-18772f19-990c-425a-97d4-165ab444f142 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:18.270409 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-18772f19-990c-425a-97d4-165ab444f142 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:18.270895 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-18772f19-990c-425a-97d4-165ab444f142 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:18.271332 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-18772f19-990c-425a-97d4-165ab444f142 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:18.272023 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-18772f19-990c-425a-97d4-165ab444f142 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:18.272479 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-18772f19-990c-425a-97d4-165ab444f142 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:18.272906 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-18772f19-990c-425a-97d4-165ab444f142 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:18.400374 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-18772f19-990c-425a-97d4-165ab444f142 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745deef0124c480cb48ebe7efaea546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f21e0f1dc4c2da5e743e6d01154a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:18.409428 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-18772f19-990c-425a-97d4-165ab444f142 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065" status: 200 len: 1722 microversion: 2.1 time: 0.150479 Aug 31 19:30:18.409998 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 578/1154] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:30:18 2022] GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:30:19.430171 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-87d8688f-2678-47ea-8cd2-6a05907d83e0 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:19.430719 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-87d8688f-2678-47ea-8cd2-6a05907d83e0 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:19.437654 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-87d8688f-2678-47ea-8cd2-6a05907d83e0 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:19.438135 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-87d8688f-2678-47ea-8cd2-6a05907d83e0 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:19.438567 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-87d8688f-2678-47ea-8cd2-6a05907d83e0 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:19.439252 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-87d8688f-2678-47ea-8cd2-6a05907d83e0 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:19.439701 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-87d8688f-2678-47ea-8cd2-6a05907d83e0 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:19.440119 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-87d8688f-2678-47ea-8cd2-6a05907d83e0 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:19.568470 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-87d8688f-2678-47ea-8cd2-6a05907d83e0 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745deef0124c480cb48ebe7efaea546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f21e0f1dc4c2da5e743e6d01154a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:19.577182 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-87d8688f-2678-47ea-8cd2-6a05907d83e0 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065" status: 200 len: 1722 microversion: 2.1 time: 0.150978 Aug 31 19:30:19.577769 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 577/1155] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:30:19 2022] GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:30:20.598309 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-5ca5007e-f98f-4c96-86d4-30033ba0c50d tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:20.598917 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-5ca5007e-f98f-4c96-86d4-30033ba0c50d tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:20.605481 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5ca5007e-f98f-4c96-86d4-30033ba0c50d tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:20.605965 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5ca5007e-f98f-4c96-86d4-30033ba0c50d tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:20.606397 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5ca5007e-f98f-4c96-86d4-30033ba0c50d tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:20.607090 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5ca5007e-f98f-4c96-86d4-30033ba0c50d tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:20.607545 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5ca5007e-f98f-4c96-86d4-30033ba0c50d tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:20.607969 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5ca5007e-f98f-4c96-86d4-30033ba0c50d tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:20.742517 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-5ca5007e-f98f-4c96-86d4-30033ba0c50d tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745deef0124c480cb48ebe7efaea546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f21e0f1dc4c2da5e743e6d01154a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:20.750814 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-5ca5007e-f98f-4c96-86d4-30033ba0c50d tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065" status: 200 len: 1722 microversion: 2.1 time: 0.156486 Aug 31 19:30:20.751376 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 579/1156] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:30:20 2022] GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:30:21.771834 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-4f4abd96-16b6-4f4e-b054-5181c1ebd868 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:21.772445 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-4f4abd96-16b6-4f4e-b054-5181c1ebd868 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:21.779642 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4f4abd96-16b6-4f4e-b054-5181c1ebd868 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:21.780127 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4f4abd96-16b6-4f4e-b054-5181c1ebd868 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:21.780563 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4f4abd96-16b6-4f4e-b054-5181c1ebd868 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:21.781272 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4f4abd96-16b6-4f4e-b054-5181c1ebd868 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:21.781727 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4f4abd96-16b6-4f4e-b054-5181c1ebd868 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:21.782148 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4f4abd96-16b6-4f4e-b054-5181c1ebd868 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:21.909368 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-4f4abd96-16b6-4f4e-b054-5181c1ebd868 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745deef0124c480cb48ebe7efaea546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f21e0f1dc4c2da5e743e6d01154a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:21.917542 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-4f4abd96-16b6-4f4e-b054-5181c1ebd868 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065" status: 200 len: 1722 microversion: 2.1 time: 0.149540 Aug 31 19:30:21.918722 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 578/1157] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:30:21 2022] GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:30:22.939695 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-b070102c-dd4e-4f4a-a5ae-e527b661f7ce tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:22.940493 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-b070102c-dd4e-4f4a-a5ae-e527b661f7ce tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:22.946593 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b070102c-dd4e-4f4a-a5ae-e527b661f7ce tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:22.947071 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b070102c-dd4e-4f4a-a5ae-e527b661f7ce tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:22.947492 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b070102c-dd4e-4f4a-a5ae-e527b661f7ce tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:22.948166 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b070102c-dd4e-4f4a-a5ae-e527b661f7ce tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:22.948607 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b070102c-dd4e-4f4a-a5ae-e527b661f7ce tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:22.949022 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b070102c-dd4e-4f4a-a5ae-e527b661f7ce tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:23.078426 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-b070102c-dd4e-4f4a-a5ae-e527b661f7ce tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745deef0124c480cb48ebe7efaea546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f21e0f1dc4c2da5e743e6d01154a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:23.086692 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-b070102c-dd4e-4f4a-a5ae-e527b661f7ce tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065" status: 200 len: 1722 microversion: 2.1 time: 0.150899 Aug 31 19:30:23.087264 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 580/1158] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:30:22 2022] GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:30:24.107922 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-22b33c83-15a3-4219-8176-c3419eca0ccb tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:24.108561 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-22b33c83-15a3-4219-8176-c3419eca0ccb tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:24.115032 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-22b33c83-15a3-4219-8176-c3419eca0ccb tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:24.115514 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-22b33c83-15a3-4219-8176-c3419eca0ccb tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:24.115946 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-22b33c83-15a3-4219-8176-c3419eca0ccb tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:24.116633 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-22b33c83-15a3-4219-8176-c3419eca0ccb tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:24.117079 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-22b33c83-15a3-4219-8176-c3419eca0ccb tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:24.117551 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-22b33c83-15a3-4219-8176-c3419eca0ccb tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:24.246846 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-22b33c83-15a3-4219-8176-c3419eca0ccb tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745deef0124c480cb48ebe7efaea546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f21e0f1dc4c2da5e743e6d01154a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:24.255124 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-22b33c83-15a3-4219-8176-c3419eca0ccb tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065" status: 200 len: 1722 microversion: 2.1 time: 0.151114 Aug 31 19:30:24.255691 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 579/1159] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:30:24 2022] GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:30:25.275825 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-96cf9b1c-7f88-4061-af0f-f6450c92ebac tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:25.276433 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-96cf9b1c-7f88-4061-af0f-f6450c92ebac tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:25.282836 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-96cf9b1c-7f88-4061-af0f-f6450c92ebac tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:25.283319 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-96cf9b1c-7f88-4061-af0f-f6450c92ebac tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:25.283747 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-96cf9b1c-7f88-4061-af0f-f6450c92ebac tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:25.284424 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-96cf9b1c-7f88-4061-af0f-f6450c92ebac tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:25.284870 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-96cf9b1c-7f88-4061-af0f-f6450c92ebac tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:25.285324 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-96cf9b1c-7f88-4061-af0f-f6450c92ebac tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:25.412967 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-96cf9b1c-7f88-4061-af0f-f6450c92ebac tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745deef0124c480cb48ebe7efaea546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f21e0f1dc4c2da5e743e6d01154a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:25.421846 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-96cf9b1c-7f88-4061-af0f-f6450c92ebac tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065" status: 200 len: 1722 microversion: 2.1 time: 0.149905 Aug 31 19:30:25.422413 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 581/1160] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:30:25 2022] GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:30:26.442945 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-cbe8dbc9-b52c-46c5-8dfc-0969af14c5a9 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:26.443543 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-cbe8dbc9-b52c-46c5-8dfc-0969af14c5a9 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:26.451358 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cbe8dbc9-b52c-46c5-8dfc-0969af14c5a9 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:26.451782 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cbe8dbc9-b52c-46c5-8dfc-0969af14c5a9 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:26.452215 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cbe8dbc9-b52c-46c5-8dfc-0969af14c5a9 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:26.452906 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cbe8dbc9-b52c-46c5-8dfc-0969af14c5a9 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:26.453381 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cbe8dbc9-b52c-46c5-8dfc-0969af14c5a9 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:26.453803 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cbe8dbc9-b52c-46c5-8dfc-0969af14c5a9 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:26.584072 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-cbe8dbc9-b52c-46c5-8dfc-0969af14c5a9 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745deef0124c480cb48ebe7efaea546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f21e0f1dc4c2da5e743e6d01154a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:26.592998 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-cbe8dbc9-b52c-46c5-8dfc-0969af14c5a9 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065" status: 200 len: 1722 microversion: 2.1 time: 0.153941 Aug 31 19:30:26.593593 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 580/1161] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:30:26 2022] GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:30:27.613007 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-c2d91cff-2475-4533-97f8-a38f53690243 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:27.613645 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-c2d91cff-2475-4533-97f8-a38f53690243 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:27.620333 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c2d91cff-2475-4533-97f8-a38f53690243 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:27.620843 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c2d91cff-2475-4533-97f8-a38f53690243 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:27.621829 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c2d91cff-2475-4533-97f8-a38f53690243 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:27.622517 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c2d91cff-2475-4533-97f8-a38f53690243 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:27.622964 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c2d91cff-2475-4533-97f8-a38f53690243 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:27.623382 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c2d91cff-2475-4533-97f8-a38f53690243 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:27.755949 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-c2d91cff-2475-4533-97f8-a38f53690243 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745deef0124c480cb48ebe7efaea546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f21e0f1dc4c2da5e743e6d01154a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:27.758372 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:30:27.766266 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-c2d91cff-2475-4533-97f8-a38f53690243 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065" status: 200 len: 1722 microversion: 2.1 time: 0.157089 Aug 31 19:30:27.766953 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 582/1162] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:30:27 2022] GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:30:28.787021 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-13455702-064d-426a-b43a-8d6717e13ea6 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:28.787608 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-13455702-064d-426a-b43a-8d6717e13ea6 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:28.793939 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-13455702-064d-426a-b43a-8d6717e13ea6 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:28.794906 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-13455702-064d-426a-b43a-8d6717e13ea6 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:28.795331 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-13455702-064d-426a-b43a-8d6717e13ea6 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:28.796003 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-13455702-064d-426a-b43a-8d6717e13ea6 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:28.796446 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-13455702-064d-426a-b43a-8d6717e13ea6 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:28.796854 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-13455702-064d-426a-b43a-8d6717e13ea6 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:28.927577 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-13455702-064d-426a-b43a-8d6717e13ea6 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745deef0124c480cb48ebe7efaea546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f21e0f1dc4c2da5e743e6d01154a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:28.937288 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-13455702-064d-426a-b43a-8d6717e13ea6 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065" status: 200 len: 1699 microversion: 2.1 time: 0.154057 Aug 31 19:30:28.937864 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 581/1163] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:30:28 2022] GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065 => generated 1699 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:30:28.957324 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-1099690e-6154-4771-9d45-393724025b5c tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:30:28.960121 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=23 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:30:28.966903 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1099690e-6154-4771-9d45-393724025b5c tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:28.967390 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1099690e-6154-4771-9d45-393724025b5c tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:28.967827 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1099690e-6154-4771-9d45-393724025b5c tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:28.990015 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-1099690e-6154-4771-9d45-393724025b5c tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Going to try to start instance {{(pid=120623) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 31 19:30:29.031526 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-1099690e-6154-4771-9d45-393724025b5c tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "POST /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065/action" status: 202 len: 0 microversion: 2.1 time: 0.077924 Aug 31 19:30:29.032136 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 583/1164] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 31 19:30:28 2022] POST /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:30:29.040308 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-544867c9-469e-4184-a359-8557ecd72afe tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:29.040849 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-544867c9-469e-4184-a359-8557ecd72afe tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:29.047651 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-544867c9-469e-4184-a359-8557ecd72afe tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:29.048181 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-544867c9-469e-4184-a359-8557ecd72afe tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:29.048616 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-544867c9-469e-4184-a359-8557ecd72afe tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:29.049350 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-544867c9-469e-4184-a359-8557ecd72afe tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:29.049804 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-544867c9-469e-4184-a359-8557ecd72afe tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:29.050234 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-544867c9-469e-4184-a359-8557ecd72afe tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:29.212610 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-544867c9-469e-4184-a359-8557ecd72afe tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745deef0124c480cb48ebe7efaea546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f21e0f1dc4c2da5e743e6d01154a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:29.222010 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-544867c9-469e-4184-a359-8557ecd72afe tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065" status: 200 len: 1708 microversion: 2.1 time: 0.185537 Aug 31 19:30:29.222586 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 582/1165] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:30:29 2022] GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065 => generated 1708 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:30:30.244420 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-1908343a-0477-4b57-b14d-5f695adabce5 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:30.245115 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-1908343a-0477-4b57-b14d-5f695adabce5 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:30.251298 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1908343a-0477-4b57-b14d-5f695adabce5 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:30.251786 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1908343a-0477-4b57-b14d-5f695adabce5 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:30.252216 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1908343a-0477-4b57-b14d-5f695adabce5 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:30.252914 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1908343a-0477-4b57-b14d-5f695adabce5 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:30.253402 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1908343a-0477-4b57-b14d-5f695adabce5 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:30.253830 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1908343a-0477-4b57-b14d-5f695adabce5 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:30.385166 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1908343a-0477-4b57-b14d-5f695adabce5 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745deef0124c480cb48ebe7efaea546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f21e0f1dc4c2da5e743e6d01154a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:30.393817 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-1908343a-0477-4b57-b14d-5f695adabce5 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065" status: 200 len: 1708 microversion: 2.1 time: 0.154101 Aug 31 19:30:30.394381 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 584/1166] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:30:30 2022] GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065 => generated 1708 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:30:31.415109 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-0e3fd794-e837-42cd-86d3-891964e2d117 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:31.415644 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-0e3fd794-e837-42cd-86d3-891964e2d117 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:31.418068 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_api:SELECT=25 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:30:31.424385 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0e3fd794-e837-42cd-86d3-891964e2d117 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:31.424872 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0e3fd794-e837-42cd-86d3-891964e2d117 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:31.425338 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0e3fd794-e837-42cd-86d3-891964e2d117 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:31.426033 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0e3fd794-e837-42cd-86d3-891964e2d117 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:31.426507 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0e3fd794-e837-42cd-86d3-891964e2d117 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:31.426929 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0e3fd794-e837-42cd-86d3-891964e2d117 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:31.429555 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:30:31.558270 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-0e3fd794-e837-42cd-86d3-891964e2d117 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745deef0124c480cb48ebe7efaea546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f21e0f1dc4c2da5e743e6d01154a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:31.566556 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-0e3fd794-e837-42cd-86d3-891964e2d117 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065" status: 200 len: 1712 microversion: 2.1 time: 0.155577 Aug 31 19:30:31.567123 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 583/1167] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:30:31 2022] GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065 => generated 1712 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:34.845560 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=3 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:34.846447 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:34.851103 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-a66ddb3f-5f83-4248-b4bb-be14a09edcce tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:34.851587 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-a66ddb3f-5f83-4248-b4bb-be14a09edcce tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:34.859068 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a66ddb3f-5f83-4248-b4bb-be14a09edcce tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:34.859551 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a66ddb3f-5f83-4248-b4bb-be14a09edcce tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:34.859977 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a66ddb3f-5f83-4248-b4bb-be14a09edcce tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:34.860673 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a66ddb3f-5f83-4248-b4bb-be14a09edcce tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:34.861122 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a66ddb3f-5f83-4248-b4bb-be14a09edcce tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:34.861565 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a66ddb3f-5f83-4248-b4bb-be14a09edcce tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:34.945538 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.objects.instance [None req-a66ddb3f-5f83-4248-b4bb-be14a09edcce tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lazy-loading 'services' on Instance uuid b81447ec-0b34-4911-b4f7-44ade9239065 {{(pid=120623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:31:35.027458 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-a66ddb3f-5f83-4248-b4bb-be14a09edcce tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "DELETE /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065/os-volume_attachments/95380107-cce7-40c0-8bf3-b655491d7fcd" status: 202 len: 0 microversion: 2.1 time: 0.183614 Aug 31 19:31:35.028231 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 585/1168] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Aug 31 19:31:34 2022] DELETE /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065/os-volume_attachments/95380107-cce7-40c0-8bf3-b655491d7fcd => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:31:36.145819 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_api:SELECT=1 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:36.146543 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=5 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:36.150734 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-7265ba31-15a2-4c55-897c-0c90d2ecfdc5 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:31:36.157398 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7265ba31-15a2-4c55-897c-0c90d2ecfdc5 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:36.157877 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7265ba31-15a2-4c55-897c-0c90d2ecfdc5 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:36.158308 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7265ba31-15a2-4c55-897c-0c90d2ecfdc5 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:36.217508 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-7265ba31-15a2-4c55-897c-0c90d2ecfdc5 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Going to try to stop instance {{(pid=120624) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 31 19:31:36.260378 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-7265ba31-15a2-4c55-897c-0c90d2ecfdc5 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "POST /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065/action" status: 202 len: 0 microversion: 2.1 time: 0.115916 Aug 31 19:31:36.260885 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 584/1169] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 31 19:31:36 2022] POST /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:31:36.270436 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-806e7157-61b8-40e8-9f69-899551edfdde tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:36.271214 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-806e7157-61b8-40e8-9f69-899551edfdde tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:36.278198 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-806e7157-61b8-40e8-9f69-899551edfdde tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:36.278751 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-806e7157-61b8-40e8-9f69-899551edfdde tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:36.279422 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-806e7157-61b8-40e8-9f69-899551edfdde tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:36.280182 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-806e7157-61b8-40e8-9f69-899551edfdde tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:36.280637 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-806e7157-61b8-40e8-9f69-899551edfdde tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:36.281063 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-806e7157-61b8-40e8-9f69-899551edfdde tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:36.413103 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-806e7157-61b8-40e8-9f69-899551edfdde tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745deef0124c480cb48ebe7efaea546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f21e0f1dc4c2da5e743e6d01154a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:36.421530 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-806e7157-61b8-40e8-9f69-899551edfdde tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065" status: 200 len: 1676 microversion: 2.1 time: 0.155946 Aug 31 19:31:36.422095 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 586/1170] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:36 2022] GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:31:37.443335 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-ffc7af46-cc26-4740-9582-478f71b73dbd tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:37.443937 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-ffc7af46-cc26-4740-9582-478f71b73dbd tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:37.450044 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ffc7af46-cc26-4740-9582-478f71b73dbd tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:37.450515 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ffc7af46-cc26-4740-9582-478f71b73dbd tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:37.450935 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ffc7af46-cc26-4740-9582-478f71b73dbd tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:37.451603 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ffc7af46-cc26-4740-9582-478f71b73dbd tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:37.452043 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ffc7af46-cc26-4740-9582-478f71b73dbd tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:37.452466 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ffc7af46-cc26-4740-9582-478f71b73dbd tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:37.582074 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-ffc7af46-cc26-4740-9582-478f71b73dbd tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745deef0124c480cb48ebe7efaea546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f21e0f1dc4c2da5e743e6d01154a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:37.589682 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-ffc7af46-cc26-4740-9582-478f71b73dbd tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065" status: 200 len: 1676 microversion: 2.1 time: 0.151161 Aug 31 19:31:37.590256 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 585/1171] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:37 2022] GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:38.610391 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-4d6a4189-6b9d-4b86-81ba-2923b0af2455 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:38.610996 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-4d6a4189-6b9d-4b86-81ba-2923b0af2455 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:38.613661 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 19:31:38.613824 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Wed Aug 31 19:31:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065 (ip 10.222.0.65) !!! Aug 31 19:31:38.615704 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 19:31:38.615820 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Wed Aug 31 19:31:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065 (ip 10.222.0.65) !!! Aug 31 19:31:38.624055 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4d6a4189-6b9d-4b86-81ba-2923b0af2455 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:38.624518 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4d6a4189-6b9d-4b86-81ba-2923b0af2455 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:38.625093 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4d6a4189-6b9d-4b86-81ba-2923b0af2455 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:38.625920 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4d6a4189-6b9d-4b86-81ba-2923b0af2455 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:38.626382 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4d6a4189-6b9d-4b86-81ba-2923b0af2455 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:38.626812 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4d6a4189-6b9d-4b86-81ba-2923b0af2455 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:38.755112 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-4d6a4189-6b9d-4b86-81ba-2923b0af2455 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745deef0124c480cb48ebe7efaea546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f21e0f1dc4c2da5e743e6d01154a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:38.763372 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-4d6a4189-6b9d-4b86-81ba-2923b0af2455 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065" status: 200 len: 1676 microversion: 2.1 time: 0.156952 Aug 31 19:31:38.763934 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 587/1172] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:38 2022] GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:39.784260 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-e260a05d-3a64-46fc-8970-533441e03f96 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:39.784871 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-e260a05d-3a64-46fc-8970-533441e03f96 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:39.791928 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e260a05d-3a64-46fc-8970-533441e03f96 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:39.792409 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e260a05d-3a64-46fc-8970-533441e03f96 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:39.792840 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e260a05d-3a64-46fc-8970-533441e03f96 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:39.793552 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e260a05d-3a64-46fc-8970-533441e03f96 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:39.794002 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e260a05d-3a64-46fc-8970-533441e03f96 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:39.794420 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e260a05d-3a64-46fc-8970-533441e03f96 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:39.812269 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 19:31:39.812424 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Wed Aug 31 19:31:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065 (ip 10.222.0.65) !!! Aug 31 19:31:39.813679 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 19:31:39.813810 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Wed Aug 31 19:31:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065 (ip 10.222.0.65) !!! Aug 31 19:31:39.929476 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-e260a05d-3a64-46fc-8970-533441e03f96 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745deef0124c480cb48ebe7efaea546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f21e0f1dc4c2da5e743e6d01154a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:39.937101 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-e260a05d-3a64-46fc-8970-533441e03f96 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065" status: 200 len: 1676 microversion: 2.1 time: 0.156732 Aug 31 19:31:39.937694 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 586/1173] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:39 2022] GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:40.958008 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-73baa342-ed8b-4b11-b1f5-d6a67059b66d tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:40.958610 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-73baa342-ed8b-4b11-b1f5-d6a67059b66d tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:40.964929 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-73baa342-ed8b-4b11-b1f5-d6a67059b66d tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:40.965442 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-73baa342-ed8b-4b11-b1f5-d6a67059b66d tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:40.966107 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-73baa342-ed8b-4b11-b1f5-d6a67059b66d tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:40.966782 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-73baa342-ed8b-4b11-b1f5-d6a67059b66d tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:40.967222 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-73baa342-ed8b-4b11-b1f5-d6a67059b66d tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:40.967632 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-73baa342-ed8b-4b11-b1f5-d6a67059b66d tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:41.096178 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-73baa342-ed8b-4b11-b1f5-d6a67059b66d tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745deef0124c480cb48ebe7efaea546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f21e0f1dc4c2da5e743e6d01154a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:41.104325 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-73baa342-ed8b-4b11-b1f5-d6a67059b66d tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065" status: 200 len: 1676 microversion: 2.1 time: 0.150225 Aug 31 19:31:41.104888 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 588/1174] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:40 2022] GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065 => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:42.125599 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-e3560586-6d0c-4e2e-a9ce-ebae6f7cce27 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:42.126206 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-e3560586-6d0c-4e2e-a9ce-ebae6f7cce27 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:42.132561 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e3560586-6d0c-4e2e-a9ce-ebae6f7cce27 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:42.133040 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e3560586-6d0c-4e2e-a9ce-ebae6f7cce27 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:42.133509 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e3560586-6d0c-4e2e-a9ce-ebae6f7cce27 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:42.134195 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e3560586-6d0c-4e2e-a9ce-ebae6f7cce27 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:42.135267 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e3560586-6d0c-4e2e-a9ce-ebae6f7cce27 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:42.135687 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e3560586-6d0c-4e2e-a9ce-ebae6f7cce27 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:42.265367 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-e3560586-6d0c-4e2e-a9ce-ebae6f7cce27 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745deef0124c480cb48ebe7efaea546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f21e0f1dc4c2da5e743e6d01154a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:42.273231 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-e3560586-6d0c-4e2e-a9ce-ebae6f7cce27 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065" status: 200 len: 1676 microversion: 2.1 time: 0.151513 Aug 31 19:31:42.273801 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 587/1175] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:42 2022] GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:43.293045 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e480417f-97d3-4c82-a66b-1d9958eeb495 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:43.293701 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-e480417f-97d3-4c82-a66b-1d9958eeb495 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:43.299932 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e480417f-97d3-4c82-a66b-1d9958eeb495 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:43.300433 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e480417f-97d3-4c82-a66b-1d9958eeb495 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:43.300856 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e480417f-97d3-4c82-a66b-1d9958eeb495 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:43.301557 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e480417f-97d3-4c82-a66b-1d9958eeb495 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:43.302003 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e480417f-97d3-4c82-a66b-1d9958eeb495 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:43.302412 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e480417f-97d3-4c82-a66b-1d9958eeb495 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:43.447770 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e480417f-97d3-4c82-a66b-1d9958eeb495 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745deef0124c480cb48ebe7efaea546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f21e0f1dc4c2da5e743e6d01154a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:43.455628 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-e480417f-97d3-4c82-a66b-1d9958eeb495 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065" status: 200 len: 1676 microversion: 2.1 time: 0.166332 Aug 31 19:31:43.456183 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 589/1176] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:43 2022] GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065 => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:44.477002 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-b288859f-7a30-4ea3-9864-156f5adf57e5 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:44.477563 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-b288859f-7a30-4ea3-9864-156f5adf57e5 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:44.484580 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b288859f-7a30-4ea3-9864-156f5adf57e5 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:44.485056 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b288859f-7a30-4ea3-9864-156f5adf57e5 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:44.485522 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b288859f-7a30-4ea3-9864-156f5adf57e5 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:44.486206 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b288859f-7a30-4ea3-9864-156f5adf57e5 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:44.486653 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b288859f-7a30-4ea3-9864-156f5adf57e5 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:44.487068 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b288859f-7a30-4ea3-9864-156f5adf57e5 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:44.614469 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-b288859f-7a30-4ea3-9864-156f5adf57e5 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745deef0124c480cb48ebe7efaea546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f21e0f1dc4c2da5e743e6d01154a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:44.622234 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-b288859f-7a30-4ea3-9864-156f5adf57e5 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065" status: 200 len: 1676 microversion: 2.1 time: 0.149204 Aug 31 19:31:44.622799 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 588/1177] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:44 2022] GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065 => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:45.643453 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-667863fa-b454-4250-afbb-205980d11304 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:45.644047 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-667863fa-b454-4250-afbb-205980d11304 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:45.650546 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-667863fa-b454-4250-afbb-205980d11304 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:45.651026 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-667863fa-b454-4250-afbb-205980d11304 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:45.651454 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-667863fa-b454-4250-afbb-205980d11304 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:45.652131 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-667863fa-b454-4250-afbb-205980d11304 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:45.652580 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-667863fa-b454-4250-afbb-205980d11304 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:45.652995 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-667863fa-b454-4250-afbb-205980d11304 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:45.779956 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-667863fa-b454-4250-afbb-205980d11304 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745deef0124c480cb48ebe7efaea546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f21e0f1dc4c2da5e743e6d01154a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:45.787481 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-667863fa-b454-4250-afbb-205980d11304 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065" status: 200 len: 1676 microversion: 2.1 time: 0.148009 Aug 31 19:31:45.788040 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 590/1178] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:45 2022] GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065 => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:46.808030 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-f962d1a2-0688-4fc2-8e2f-b5688de7d366 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:46.808620 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-f962d1a2-0688-4fc2-8e2f-b5688de7d366 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:46.814682 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f962d1a2-0688-4fc2-8e2f-b5688de7d366 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:46.815153 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f962d1a2-0688-4fc2-8e2f-b5688de7d366 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:46.815576 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f962d1a2-0688-4fc2-8e2f-b5688de7d366 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:46.816248 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f962d1a2-0688-4fc2-8e2f-b5688de7d366 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:46.816694 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f962d1a2-0688-4fc2-8e2f-b5688de7d366 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:46.817100 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f962d1a2-0688-4fc2-8e2f-b5688de7d366 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:46.946091 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-f962d1a2-0688-4fc2-8e2f-b5688de7d366 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745deef0124c480cb48ebe7efaea546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f21e0f1dc4c2da5e743e6d01154a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:46.954273 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-f962d1a2-0688-4fc2-8e2f-b5688de7d366 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065" status: 200 len: 1653 microversion: 2.1 time: 0.150336 Aug 31 19:31:46.954840 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 589/1179] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:46 2022] GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065 => generated 1653 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:46.975001 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-56f26970-ee91-4b4c-8276-2dd76e85deac tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:31:46.981555 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-56f26970-ee91-4b4c-8276-2dd76e85deac tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:46.982045 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-56f26970-ee91-4b4c-8276-2dd76e85deac tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:46.982490 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-56f26970-ee91-4b4c-8276-2dd76e85deac tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:47.003917 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-56f26970-ee91-4b4c-8276-2dd76e85deac tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Going to try to start instance {{(pid=120623) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 31 19:31:47.046200 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-56f26970-ee91-4b4c-8276-2dd76e85deac tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "POST /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065/action" status: 202 len: 0 microversion: 2.1 time: 0.074450 Aug 31 19:31:47.046797 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 591/1180] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 31 19:31:46 2022] POST /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:31:47.055049 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-badbec64-1c71-449a-95c5-6d435b01cc92 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:47.055657 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-badbec64-1c71-449a-95c5-6d435b01cc92 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:47.062366 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-badbec64-1c71-449a-95c5-6d435b01cc92 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:47.062734 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-badbec64-1c71-449a-95c5-6d435b01cc92 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:47.063149 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-badbec64-1c71-449a-95c5-6d435b01cc92 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:47.064030 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-badbec64-1c71-449a-95c5-6d435b01cc92 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:47.064503 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-badbec64-1c71-449a-95c5-6d435b01cc92 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:47.064922 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-badbec64-1c71-449a-95c5-6d435b01cc92 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:47.231900 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-badbec64-1c71-449a-95c5-6d435b01cc92 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745deef0124c480cb48ebe7efaea546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f21e0f1dc4c2da5e743e6d01154a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:47.240143 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-badbec64-1c71-449a-95c5-6d435b01cc92 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065" status: 200 len: 1662 microversion: 2.1 time: 0.188821 Aug 31 19:31:47.241484 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 590/1181] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:47 2022] GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065 => generated 1662 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:48.262759 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-a31d2060-cf77-4bbf-ab38-90fb5e867ce8 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:48.264221 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-a31d2060-cf77-4bbf-ab38-90fb5e867ce8 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:48.271183 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a31d2060-cf77-4bbf-ab38-90fb5e867ce8 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:48.271640 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a31d2060-cf77-4bbf-ab38-90fb5e867ce8 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:48.272064 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a31d2060-cf77-4bbf-ab38-90fb5e867ce8 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:48.272748 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a31d2060-cf77-4bbf-ab38-90fb5e867ce8 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:48.273207 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a31d2060-cf77-4bbf-ab38-90fb5e867ce8 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:48.273627 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a31d2060-cf77-4bbf-ab38-90fb5e867ce8 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:48.408935 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-a31d2060-cf77-4bbf-ab38-90fb5e867ce8 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745deef0124c480cb48ebe7efaea546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f21e0f1dc4c2da5e743e6d01154a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:48.416750 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-a31d2060-cf77-4bbf-ab38-90fb5e867ce8 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065" status: 200 len: 1662 microversion: 2.1 time: 0.158893 Aug 31 19:31:48.417345 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 592/1182] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:48 2022] GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065 => generated 1662 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:49.437633 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-1e552ecc-33e5-4978-aca2-aceb4aa7b610 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:49.438182 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-1e552ecc-33e5-4978-aca2-aceb4aa7b610 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:49.444504 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1e552ecc-33e5-4978-aca2-aceb4aa7b610 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:49.444985 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1e552ecc-33e5-4978-aca2-aceb4aa7b610 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:49.445472 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1e552ecc-33e5-4978-aca2-aceb4aa7b610 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:49.446159 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1e552ecc-33e5-4978-aca2-aceb4aa7b610 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:49.446607 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1e552ecc-33e5-4978-aca2-aceb4aa7b610 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:49.447026 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1e552ecc-33e5-4978-aca2-aceb4aa7b610 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:49.577569 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-1e552ecc-33e5-4978-aca2-aceb4aa7b610 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745deef0124c480cb48ebe7efaea546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f21e0f1dc4c2da5e743e6d01154a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:49.585168 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-1e552ecc-33e5-4978-aca2-aceb4aa7b610 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065" status: 200 len: 1666 microversion: 2.1 time: 0.151541 Aug 31 19:31:49.585761 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 591/1183] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:49 2022] GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065 => generated 1666 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:32:53.196191 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=16 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:53.196920 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:53.201169 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-2391a2ae-24bb-4567-9199-2b34bf0dad78 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:53.203419 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-2391a2ae-24bb-4567-9199-2b34bf0dad78 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:53.210501 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2391a2ae-24bb-4567-9199-2b34bf0dad78 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:53.210982 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2391a2ae-24bb-4567-9199-2b34bf0dad78 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:53.211407 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2391a2ae-24bb-4567-9199-2b34bf0dad78 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:53.212090 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2391a2ae-24bb-4567-9199-2b34bf0dad78 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:53.212531 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2391a2ae-24bb-4567-9199-2b34bf0dad78 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:53.212943 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2391a2ae-24bb-4567-9199-2b34bf0dad78 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:53.244279 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-2391a2ae-24bb-4567-9199-2b34bf0dad78 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049845 Aug 31 19:32:53.244831 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 593/1184] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 31 19:32:53 2022] GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 19:32:53.304224 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_api:SELECT=16 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:53.304952 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:53.309362 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-98639652-0727-4323-a259-69225cb85fd8 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:53.309844 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-98639652-0727-4323-a259-69225cb85fd8 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:53.316995 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-98639652-0727-4323-a259-69225cb85fd8 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:53.317501 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-98639652-0727-4323-a259-69225cb85fd8 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:53.317927 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-98639652-0727-4323-a259-69225cb85fd8 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:53.318602 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-98639652-0727-4323-a259-69225cb85fd8 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:53.319041 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-98639652-0727-4323-a259-69225cb85fd8 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:53.319449 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-98639652-0727-4323-a259-69225cb85fd8 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:53.347013 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-98639652-0727-4323-a259-69225cb85fd8 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Going to try to terminate instance {{(pid=120624) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 19:32:53.422264 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-98639652-0727-4323-a259-69225cb85fd8 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "DELETE /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065" status: 204 len: 0 microversion: 2.1 time: 0.119353 Aug 31 19:32:53.422742 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 592/1185] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 31 19:32:53 2022] DELETE /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:32:53.430911 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-5cacd7db-cb45-4816-be9f-8c59875f3ab5 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:53.431519 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-5cacd7db-cb45-4816-be9f-8c59875f3ab5 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:53.437387 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5cacd7db-cb45-4816-be9f-8c59875f3ab5 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:53.437868 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5cacd7db-cb45-4816-be9f-8c59875f3ab5 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:53.438295 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5cacd7db-cb45-4816-be9f-8c59875f3ab5 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:53.438974 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5cacd7db-cb45-4816-be9f-8c59875f3ab5 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:53.439421 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5cacd7db-cb45-4816-be9f-8c59875f3ab5 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:53.439838 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5cacd7db-cb45-4816-be9f-8c59875f3ab5 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:53.565702 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-5cacd7db-cb45-4816-be9f-8c59875f3ab5 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745deef0124c480cb48ebe7efaea546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f21e0f1dc4c2da5e743e6d01154a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:53.573329 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-5cacd7db-cb45-4816-be9f-8c59875f3ab5 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065" status: 200 len: 1672 microversion: 2.1 time: 0.146182 Aug 31 19:32:53.573899 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 594/1186] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:32:53 2022] GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065 => generated 1672 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:32:54.595722 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-d1e5a551-eb51-464c-84ff-6276b5938872 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:54.596419 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-d1e5a551-eb51-464c-84ff-6276b5938872 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:54.602832 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d1e5a551-eb51-464c-84ff-6276b5938872 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:54.603309 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d1e5a551-eb51-464c-84ff-6276b5938872 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:54.603736 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d1e5a551-eb51-464c-84ff-6276b5938872 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:54.604413 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d1e5a551-eb51-464c-84ff-6276b5938872 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:54.604856 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d1e5a551-eb51-464c-84ff-6276b5938872 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:54.605295 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d1e5a551-eb51-464c-84ff-6276b5938872 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:54.837756 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-d1e5a551-eb51-464c-84ff-6276b5938872 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745deef0124c480cb48ebe7efaea546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f21e0f1dc4c2da5e743e6d01154a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:54.845640 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-d1e5a551-eb51-464c-84ff-6276b5938872 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065" status: 200 len: 1672 microversion: 2.1 time: 0.254192 Aug 31 19:32:54.846265 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 593/1187] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:32:54 2022] GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065 => generated 1672 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:32:55.866895 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-a51ccdde-a992-408f-b590-19d8795c4a90 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:55.867505 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-a51ccdde-a992-408f-b590-19d8795c4a90 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:55.874047 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a51ccdde-a992-408f-b590-19d8795c4a90 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:55.874531 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a51ccdde-a992-408f-b590-19d8795c4a90 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:55.874970 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a51ccdde-a992-408f-b590-19d8795c4a90 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:55.875657 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a51ccdde-a992-408f-b590-19d8795c4a90 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:55.876115 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a51ccdde-a992-408f-b590-19d8795c4a90 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:55.876542 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a51ccdde-a992-408f-b590-19d8795c4a90 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:56.006597 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-a51ccdde-a992-408f-b590-19d8795c4a90 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745deef0124c480cb48ebe7efaea546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f21e0f1dc4c2da5e743e6d01154a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:56.014978 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-a51ccdde-a992-408f-b590-19d8795c4a90 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065" status: 200 len: 1672 microversion: 2.1 time: 0.151436 Aug 31 19:32:56.015567 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 595/1188] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:32:55 2022] GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065 => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:32:56.779787 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-19a06851-8e00-4273-b88c-6640745948c6 req-ff98df4d-526e-4681-8133-71ab3cf7fcc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b81447ec-0b34-4911-b4f7-44ade9239065", "name": "network-vif-deleted", "tag": "176aa081-1ee6-4420-929f-cb6a296a89b0"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:32:56.801331 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-19a06851-8e00-4273-b88c-6640745948c6 req-ff98df4d-526e-4681-8133-71ab3cf7fcc0 service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:56.801851 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-19a06851-8e00-4273-b88c-6640745948c6 req-ff98df4d-526e-4681-8133-71ab3cf7fcc0 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:56.802244 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-19a06851-8e00-4273-b88c-6640745948c6 req-ff98df4d-526e-4681-8133-71ab3cf7fcc0 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:56.815865 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-19a06851-8e00-4273-b88c-6640745948c6 req-ff98df4d-526e-4681-8133-71ab3cf7fcc0 service nova] Creating event network-vif-deleted:176aa081-1ee6-4420-929f-cb6a296a89b0 for instance b81447ec-0b34-4911-b4f7-44ade9239065 on hv-cinder-83538 Aug 31 19:32:56.821896 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-19a06851-8e00-4273-b88c-6640745948c6 req-ff98df4d-526e-4681-8133-71ab3cf7fcc0 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107367 Aug 31 19:32:56.823506 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 594/1189] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:32:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:32:57.035670 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-73674e08-d922-49eb-a1bc-7cb6a45a057f tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:57.036234 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-73674e08-d922-49eb-a1bc-7cb6a45a057f tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:57.042576 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-73674e08-d922-49eb-a1bc-7cb6a45a057f tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:57.043197 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-73674e08-d922-49eb-a1bc-7cb6a45a057f tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:57.043646 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-73674e08-d922-49eb-a1bc-7cb6a45a057f tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:57.044344 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-73674e08-d922-49eb-a1bc-7cb6a45a057f tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:57.044803 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-73674e08-d922-49eb-a1bc-7cb6a45a057f tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:57.045252 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-73674e08-d922-49eb-a1bc-7cb6a45a057f tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:57.078850 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-73674e08-d922-49eb-a1bc-7cb6a45a057f tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:57.079334 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-73674e08-d922-49eb-a1bc-7cb6a45a057f tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:57.079776 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-73674e08-d922-49eb-a1bc-7cb6a45a057f tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:57.080222 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.objects.instance [None req-73674e08-d922-49eb-a1bc-7cb6a45a057f tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lazy-loading 'fault' on Instance uuid b81447ec-0b34-4911-b4f7-44ade9239065 {{(pid=120623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:32:57.123771 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-73674e08-d922-49eb-a1bc-7cb6a45a057f tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745deef0124c480cb48ebe7efaea546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f21e0f1dc4c2da5e743e6d01154a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:57.131584 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-73674e08-d922-49eb-a1bc-7cb6a45a057f tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065" status: 200 len: 1325 microversion: 2.1 time: 0.099886 Aug 31 19:32:57.132362 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 596/1190] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:32:57 2022] GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065 => generated 1325 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:32:58.154437 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-da027613-adf5-42d9-b738-1685d495e984 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:58.155045 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-da027613-adf5-42d9-b738-1685d495e984 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:58.161657 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-da027613-adf5-42d9-b738-1685d495e984 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:58.162126 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-da027613-adf5-42d9-b738-1685d495e984 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:58.162546 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-da027613-adf5-42d9-b738-1685d495e984 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:58.164597 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-da027613-adf5-42d9-b738-1685d495e984 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:58.165044 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-da027613-adf5-42d9-b738-1685d495e984 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:58.165487 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-da027613-adf5-42d9-b738-1685d495e984 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:58.181544 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.wsgi [None req-da027613-adf5-42d9-b738-1685d495e984 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] HTTP exception thrown: Instance b81447ec-0b34-4911-b4f7-44ade9239065 could not be found. Aug 31 19:32:58.183119 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-da027613-adf5-42d9-b738-1685d495e984 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Request method failure captured: Aug 31 19:32:58.183119 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: request: GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065 HTTP/1.1 Aug 31 19:32:58.183119 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept: application/json Aug 31 19:32:58.183119 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Aug 31 19:32:58.183119 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Connection: close Aug 31 19:32:58.183119 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Length: 0 Aug 31 19:32:58.183119 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Type: application/json Aug 31 19:32:58.183119 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Host: 10.222.0.65 Aug 31 19:32:58.183119 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Aug 31 19:32:58.183119 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Aug 31 19:32:58.183119 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjD7ZbyJIrkC7jTEetAocjTXYnUQDJtpcjcnTmtXzp-TMfsu94L8htxusF6kVO2IQRczDu2oNyhGpo2Ej4QD5PqZNi1z_KqyslihxrQjAuowWigjE_8bQnnMpA2QcGPnfBHidZX315IT8IHLnjHQMQ6qhSWASvUlsCN23NN3tVsEPzM0Q Aug 31 19:32:58.183119 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Aug 31 19:32:58.183119 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Aug 31 19:32:58.183119 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Aug 31 19:32:58.183119 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Aug 31 19:32:58.183119 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Aug 31 19:32:58.183119 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Aug 31 19:32:58.183119 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Id: 548f21e0f1dc4c2da5e743e6d01154a3 Aug 31 19:32:58.183119 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-AttachVolumeTestJSON-1921002876 Aug 31 19:32:58.183119 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Role: member,reader Aug 31 19:32:58.183119 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Roles: member,reader Aug 31 19:32:58.184922 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/548f21e0f1dc4c2da5e743e6d01154a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/548f21e0f1dc4c2da5e743e6d01154a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_548f21e0f1dc4c2da5e743e6d01154a3", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/548f21e0f1dc4c2da5e743e6d01154a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:32:58.184922 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-AttachVolumeTestJSON-1921002876 Aug 31 19:32:58.184922 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Id: 548f21e0f1dc4c2da5e743e6d01154a3 Aug 31 19:32:58.184922 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1921002876 Aug 31 19:32:58.184922 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User: tempest-AttachVolumeTestJSON-1921002876-project Aug 31 19:32:58.184922 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Aug 31 19:32:58.184922 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Aug 31 19:32:58.184922 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Id: 745deef0124c480cb48ebe7efaea546a Aug 31 19:32:58.184922 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-AttachVolumeTestJSON-1921002876-project Aug 31 19:32:58.184922 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: method: > Aug 31 19:32:58.184922 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: exception: Instance b81447ec-0b34-4911-b4f7-44ade9239065 could not be found. Aug 31 19:32:58.184922 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: action_args: {'id': 'b81447ec-0b34-4911-b4f7-44ade9239065'} Aug 31 19:32:58.187929 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:32:58.187929 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:32:58.187929 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:32:58.187929 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:32:58.187929 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:32:58.187929 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:32:58.187929 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:32:58.187929 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:32:58.187929 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:32:58.187929 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:32:58.187929 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b81447ec-0b34-4911-b4f7-44ade9239065 could not be found. Aug 31 19:32:58.187929 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:32:58.187929 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:32:58.187929 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:32:58.187929 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:32:58.187929 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:32:58.187929 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:32:58.187929 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:32:58.187929 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:32:58.187929 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:32:58.189558 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:32:58.189558 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:32:58.189558 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:32:58.189558 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:32:58.189558 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:32:58.189558 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:32:58.189558 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:32:58.189558 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b81447ec-0b34-4911-b4f7-44ade9239065 could not be found. Aug 31 19:32:58.189558 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:32:58.189558 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:32:58.189558 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:32:58.189558 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:32:58.189558 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:32:58.189558 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:32:58.189558 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:32:58.189558 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:32:58.189558 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b81447ec-0b34-4911-b4f7-44ade9239065 could not be found. Aug 31 19:32:58.189558 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:32:58.191017 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-da027613-adf5-42d9-b738-1685d495e984 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Returning 404 to user: Instance b81447ec-0b34-4911-b4f7-44ade9239065 could not be found. {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:32:58.191017 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-da027613-adf5-42d9-b738-1685d495e984 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065" status: 404 len: 111 microversion: 2.1 time: 0.036284 Aug 31 19:32:58.191017 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 595/1191] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:32:58 2022] GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:32:58.193708 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-1b165b53-7d34-46ae-ad04-d69a9b187349 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '.version_select at 0x7fdb8618bf70>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:58.218159 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-1b165b53-7d34-46ae-ad04-d69a9b187349 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-119625968" status: 202 len: 0 microversion: 2.1 time: 0.027442 Aug 31 19:32:58.218902 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 597/1192] 10.222.0.65 () {58 vars in 1218 bytes} [Wed Aug 31 19:32:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-119625968 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:32:58.834486 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-311c88fb-6cad-462c-8769-2175c3688807 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Action: 'create', calling method: .version_select at 0x7fdb89ae50d0>, body: {"keypair": {"name": "tempest-keypair-93426680", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBR3Iu9Qp0OaQIFQcKrZyxE75PasiRzL4407Hw8IVTEFLG1JI6cw3U7L//Mlgb/IjIAtmJm0VD4KDgpmb7nlTkjsNeM6JDIJsaTfaw613O0CjH3bBzo65tstOkdYX+YR3A=="}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:32:58.850175 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-311c88fb-6cad-462c-8769-2175c3688807 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Getting quotas for project 548f21e0f1dc4c2da5e743e6d01154a3. Resources: {'key_pairs'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:32:58.853907 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-311c88fb-6cad-462c-8769-2175c3688807 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Getting quotas for user 745deef0124c480cb48ebe7efaea546a and project 548f21e0f1dc4c2da5e743e6d01154a3. Resources: {'key_pairs'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:32:58.879566 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-311c88fb-6cad-462c-8769-2175c3688807 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.048875 Aug 31 19:32:58.880969 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 596/1193] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Aug 31 19:32:58 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:33:00.127182 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e98250dc-f486-4dfe-913f-7ac4e4176cc6 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-420412847", "imageRef": "f4f2ae76-bacc-4449-881b-f697e1eeec66", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "761adef9-b54a-4114-adb2-cf72eab21f9d"}], "security_groups": [{"name": "tempest-securitygroup--1814203052"}], "key_name": "tempest-keypair-93426680", "user_data": "}} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:33:00.232825 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.network.neutron [None req-e98250dc-f486-4dfe-913f-7ac4e4176cc6 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] validate_networks() for [('761adef9-b54a-4114-adb2-cf72eab21f9d', None, None, None, None, None)] {{(pid=120623) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:33:00.602869 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-e98250dc-f486-4dfe-913f-7ac4e4176cc6 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Flavor limits 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:33:00.603298 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-e98250dc-f486-4dfe-913f-7ac4e4176cc6 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Image limits 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:33:00.603804 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-e98250dc-f486-4dfe-913f-7ac4e4176cc6 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Flavor pref 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:33:00.604212 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-e98250dc-f486-4dfe-913f-7ac4e4176cc6 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Image pref 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:33:00.604940 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-e98250dc-f486-4dfe-913f-7ac4e4176cc6 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:33:00.613716 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e98250dc-f486-4dfe-913f-7ac4e4176cc6 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:00.614202 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e98250dc-f486-4dfe-913f-7ac4e4176cc6 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:00.614635 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e98250dc-f486-4dfe-913f-7ac4e4176cc6 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:00.615368 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e98250dc-f486-4dfe-913f-7ac4e4176cc6 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:00.615824 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e98250dc-f486-4dfe-913f-7ac4e4176cc6 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:00.616250 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e98250dc-f486-4dfe-913f-7ac4e4176cc6 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:00.633089 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.quota [None req-e98250dc-f486-4dfe-913f-7ac4e4176cc6 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Getting quotas for project 548f21e0f1dc4c2da5e743e6d01154a3. Resources: {'instances', 'cores', 'ram'} {{(pid=120623) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:33:00.637041 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.quota [None req-e98250dc-f486-4dfe-913f-7ac4e4176cc6 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Getting quotas for user 745deef0124c480cb48ebe7efaea546a and project 548f21e0f1dc4c2da5e743e6d01154a3. Resources: {'instances', 'cores', 'ram'} {{(pid=120623) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:33:00.648708 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-e98250dc-f486-4dfe-913f-7ac4e4176cc6 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Going to run 1 instances... {{(pid=120623) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:33:00.650992 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-e98250dc-f486-4dfe-913f-7ac4e4176cc6 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: c01ec91b-c3b8-4293-9d37-3477d5ab9181] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f4f2ae76-bacc-4449-881b-f697e1eeec66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120623) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:33:00.702858 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-e98250dc-f486-4dfe-913f-7ac4e4176cc6 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.580477 Aug 31 19:33:00.703451 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 598/1194] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 31 19:33:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 19:33:00.715347 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-770f2842-dcc9-41fc-93bc-8cc5791d1bbc tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:00.716017 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-770f2842-dcc9-41fc-93bc-8cc5791d1bbc tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: c01ec91b-c3b8-4293-9d37-3477d5ab9181] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:00.772564 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-770f2842-dcc9-41fc-93bc-8cc5791d1bbc tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745deef0124c480cb48ebe7efaea546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f21e0f1dc4c2da5e743e6d01154a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:33:00.779453 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-770f2842-dcc9-41fc-93bc-8cc5791d1bbc tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/c01ec91b-c3b8-4293-9d37-3477d5ab9181" status: 200 len: 1235 microversion: 2.1 time: 0.068861 Aug 31 19:33:00.784868 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 597/1195] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:33:00 2022] GET /compute/v2.1/servers/c01ec91b-c3b8-4293-9d37-3477d5ab9181 => generated 1235 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:33:01.801387 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e4a8ed73-870c-4896-8285-b68639de2043 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:01.801953 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-e4a8ed73-870c-4896-8285-b68639de2043 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: c01ec91b-c3b8-4293-9d37-3477d5ab9181] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:01.808879 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e4a8ed73-870c-4896-8285-b68639de2043 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:01.809422 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e4a8ed73-870c-4896-8285-b68639de2043 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:01.809851 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e4a8ed73-870c-4896-8285-b68639de2043 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:01.810594 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e4a8ed73-870c-4896-8285-b68639de2043 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:01.811041 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e4a8ed73-870c-4896-8285-b68639de2043 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:01.811454 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e4a8ed73-870c-4896-8285-b68639de2043 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:01.878966 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e4a8ed73-870c-4896-8285-b68639de2043 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745deef0124c480cb48ebe7efaea546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f21e0f1dc4c2da5e743e6d01154a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:33:01.887851 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-e4a8ed73-870c-4896-8285-b68639de2043 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/c01ec91b-c3b8-4293-9d37-3477d5ab9181" status: 200 len: 1305 microversion: 2.1 time: 0.091841 Aug 31 19:33:01.888412 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 599/1196] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:33:01 2022] GET /compute/v2.1/servers/c01ec91b-c3b8-4293-9d37-3477d5ab9181 => generated 1305 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:33:02.908807 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-bbdde31f-3eed-4613-867f-3df9dd3af7e2 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:02.909462 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-bbdde31f-3eed-4613-867f-3df9dd3af7e2 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: c01ec91b-c3b8-4293-9d37-3477d5ab9181] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:02.916057 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bbdde31f-3eed-4613-867f-3df9dd3af7e2 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:02.916548 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bbdde31f-3eed-4613-867f-3df9dd3af7e2 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:02.916983 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bbdde31f-3eed-4613-867f-3df9dd3af7e2 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:02.917708 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bbdde31f-3eed-4613-867f-3df9dd3af7e2 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:02.918190 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bbdde31f-3eed-4613-867f-3df9dd3af7e2 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:02.918615 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bbdde31f-3eed-4613-867f-3df9dd3af7e2 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:03.125229 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-bbdde31f-3eed-4613-867f-3df9dd3af7e2 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745deef0124c480cb48ebe7efaea546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f21e0f1dc4c2da5e743e6d01154a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:33:03.132813 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-bbdde31f-3eed-4613-867f-3df9dd3af7e2 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/c01ec91b-c3b8-4293-9d37-3477d5ab9181" status: 200 len: 1361 microversion: 2.1 time: 0.228415 Aug 31 19:33:03.133416 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 598/1197] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:33:02 2022] GET /compute/v2.1/servers/c01ec91b-c3b8-4293-9d37-3477d5ab9181 => generated 1361 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:33:03.218170 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-637bb611-5480-4e20-a3af-52e1f01c013a req-e64c6ea3-6f29-4bca-b2e2-ec57a87f92ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c01ec91b-c3b8-4293-9d37-3477d5ab9181", "tag": "8f189730-3f8f-4927-acee-9a6e31849621"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:33:03.230867 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-637bb611-5480-4e20-a3af-52e1f01c013a req-e64c6ea3-6f29-4bca-b2e2-ec57a87f92ab service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:03.231343 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-637bb611-5480-4e20-a3af-52e1f01c013a req-e64c6ea3-6f29-4bca-b2e2-ec57a87f92ab service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:03.231765 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-637bb611-5480-4e20-a3af-52e1f01c013a req-e64c6ea3-6f29-4bca-b2e2-ec57a87f92ab service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:03.242939 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-637bb611-5480-4e20-a3af-52e1f01c013a req-e64c6ea3-6f29-4bca-b2e2-ec57a87f92ab service nova] Creating event network-changed:8f189730-3f8f-4927-acee-9a6e31849621 for instance c01ec91b-c3b8-4293-9d37-3477d5ab9181 on hv-cinder-83538 Aug 31 19:33:03.247896 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-637bb611-5480-4e20-a3af-52e1f01c013a req-e64c6ea3-6f29-4bca-b2e2-ec57a87f92ab service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034013 Aug 31 19:33:03.248804 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 600/1198] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:33:04.155835 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-5dddbde1-b5c5-450c-bff2-91a2a7045394 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:04.156452 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-5dddbde1-b5c5-450c-bff2-91a2a7045394 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: c01ec91b-c3b8-4293-9d37-3477d5ab9181] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:04.163068 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5dddbde1-b5c5-450c-bff2-91a2a7045394 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:04.163551 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5dddbde1-b5c5-450c-bff2-91a2a7045394 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:04.163985 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5dddbde1-b5c5-450c-bff2-91a2a7045394 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:04.164672 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5dddbde1-b5c5-450c-bff2-91a2a7045394 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:04.165126 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5dddbde1-b5c5-450c-bff2-91a2a7045394 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:04.165572 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5dddbde1-b5c5-450c-bff2-91a2a7045394 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:04.300323 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-5dddbde1-b5c5-450c-bff2-91a2a7045394 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745deef0124c480cb48ebe7efaea546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f21e0f1dc4c2da5e743e6d01154a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:33:04.307911 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-5dddbde1-b5c5-450c-bff2-91a2a7045394 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/c01ec91b-c3b8-4293-9d37-3477d5ab9181" status: 200 len: 1361 microversion: 2.1 time: 0.156023 Aug 31 19:33:04.308479 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 599/1199] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:33:04 2022] GET /compute/v2.1/servers/c01ec91b-c3b8-4293-9d37-3477d5ab9181 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:33:05.329754 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d4ca531e-3f69-4f3a-b4fa-776717efe9ce tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:05.330472 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d4ca531e-3f69-4f3a-b4fa-776717efe9ce tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: c01ec91b-c3b8-4293-9d37-3477d5ab9181] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:05.336561 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d4ca531e-3f69-4f3a-b4fa-776717efe9ce tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:05.337041 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d4ca531e-3f69-4f3a-b4fa-776717efe9ce tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:05.337505 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d4ca531e-3f69-4f3a-b4fa-776717efe9ce tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:05.338187 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d4ca531e-3f69-4f3a-b4fa-776717efe9ce tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:05.338640 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d4ca531e-3f69-4f3a-b4fa-776717efe9ce tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:05.339058 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d4ca531e-3f69-4f3a-b4fa-776717efe9ce tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:05.468009 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-d4ca531e-3f69-4f3a-b4fa-776717efe9ce tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745deef0124c480cb48ebe7efaea546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f21e0f1dc4c2da5e743e6d01154a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:33:05.476061 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-d4ca531e-3f69-4f3a-b4fa-776717efe9ce tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/c01ec91b-c3b8-4293-9d37-3477d5ab9181" status: 200 len: 1361 microversion: 2.1 time: 0.151582 Aug 31 19:33:05.476656 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 601/1200] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:33:05 2022] GET /compute/v2.1/servers/c01ec91b-c3b8-4293-9d37-3477d5ab9181 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:33:06.496426 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-88544928-adbf-4f03-b525-82889f35e669 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:06.496998 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-88544928-adbf-4f03-b525-82889f35e669 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: c01ec91b-c3b8-4293-9d37-3477d5ab9181] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:06.503476 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-88544928-adbf-4f03-b525-82889f35e669 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:06.503955 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-88544928-adbf-4f03-b525-82889f35e669 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:06.504388 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-88544928-adbf-4f03-b525-82889f35e669 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:06.505073 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-88544928-adbf-4f03-b525-82889f35e669 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:06.505561 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-88544928-adbf-4f03-b525-82889f35e669 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:06.505980 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-88544928-adbf-4f03-b525-82889f35e669 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:06.634155 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-88544928-adbf-4f03-b525-82889f35e669 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745deef0124c480cb48ebe7efaea546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f21e0f1dc4c2da5e743e6d01154a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:33:06.641745 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-88544928-adbf-4f03-b525-82889f35e669 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/c01ec91b-c3b8-4293-9d37-3477d5ab9181" status: 200 len: 1361 microversion: 2.1 time: 0.149292 Aug 31 19:33:06.642313 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 600/1201] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:33:06 2022] GET /compute/v2.1/servers/c01ec91b-c3b8-4293-9d37-3477d5ab9181 => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:33:07.662186 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-272283a2-0292-42ee-b1a6-4f2be7094eee tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:07.662783 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-272283a2-0292-42ee-b1a6-4f2be7094eee tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: c01ec91b-c3b8-4293-9d37-3477d5ab9181] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:07.669217 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-272283a2-0292-42ee-b1a6-4f2be7094eee tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:07.669721 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-272283a2-0292-42ee-b1a6-4f2be7094eee tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:07.670139 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-272283a2-0292-42ee-b1a6-4f2be7094eee tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:07.670827 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-272283a2-0292-42ee-b1a6-4f2be7094eee tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:07.671279 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-272283a2-0292-42ee-b1a6-4f2be7094eee tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:07.671708 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-272283a2-0292-42ee-b1a6-4f2be7094eee tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:07.802122 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-272283a2-0292-42ee-b1a6-4f2be7094eee tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745deef0124c480cb48ebe7efaea546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f21e0f1dc4c2da5e743e6d01154a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:33:07.809723 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-272283a2-0292-42ee-b1a6-4f2be7094eee tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/c01ec91b-c3b8-4293-9d37-3477d5ab9181" status: 200 len: 1361 microversion: 2.1 time: 0.151440 Aug 31 19:33:07.810289 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 602/1202] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:33:07 2022] GET /compute/v2.1/servers/c01ec91b-c3b8-4293-9d37-3477d5ab9181 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:33:08.151436 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-83bcd854-7d30-41dc-9420-6eb7ad192f0d req-78f64c9c-5e3a-493f-9718-ce1172b4c909 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c01ec91b-c3b8-4293-9d37-3477d5ab9181", "name": "network-vif-plugged", "status": "completed", "tag": "8f189730-3f8f-4927-acee-9a6e31849621"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:33:08.161867 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-83bcd854-7d30-41dc-9420-6eb7ad192f0d req-78f64c9c-5e3a-493f-9718-ce1172b4c909 service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:08.162337 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-83bcd854-7d30-41dc-9420-6eb7ad192f0d req-78f64c9c-5e3a-493f-9718-ce1172b4c909 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:08.162809 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-83bcd854-7d30-41dc-9420-6eb7ad192f0d req-78f64c9c-5e3a-493f-9718-ce1172b4c909 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:08.174702 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-83bcd854-7d30-41dc-9420-6eb7ad192f0d req-78f64c9c-5e3a-493f-9718-ce1172b4c909 service nova] Creating event network-vif-plugged:8f189730-3f8f-4927-acee-9a6e31849621 for instance c01ec91b-c3b8-4293-9d37-3477d5ab9181 on hv-cinder-83538 Aug 31 19:33:08.179650 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-83bcd854-7d30-41dc-9420-6eb7ad192f0d req-78f64c9c-5e3a-493f-9718-ce1172b4c909 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089005 Aug 31 19:33:08.180218 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 601/1203] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:33:08.831388 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-3b76eca6-36d9-43ab-8745-5e4eda2b798f tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:08.831993 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-3b76eca6-36d9-43ab-8745-5e4eda2b798f tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: c01ec91b-c3b8-4293-9d37-3477d5ab9181] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:08.838460 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3b76eca6-36d9-43ab-8745-5e4eda2b798f tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:08.838945 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3b76eca6-36d9-43ab-8745-5e4eda2b798f tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:08.839381 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3b76eca6-36d9-43ab-8745-5e4eda2b798f tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:08.840327 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3b76eca6-36d9-43ab-8745-5e4eda2b798f tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:08.840780 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3b76eca6-36d9-43ab-8745-5e4eda2b798f tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:08.841223 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3b76eca6-36d9-43ab-8745-5e4eda2b798f tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:08.966120 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-3b76eca6-36d9-43ab-8745-5e4eda2b798f tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745deef0124c480cb48ebe7efaea546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f21e0f1dc4c2da5e743e6d01154a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:33:08.973630 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-3b76eca6-36d9-43ab-8745-5e4eda2b798f tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/c01ec91b-c3b8-4293-9d37-3477d5ab9181" status: 200 len: 1361 microversion: 2.1 time: 0.146790 Aug 31 19:33:08.974186 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 603/1204] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:33:08 2022] GET /compute/v2.1/servers/c01ec91b-c3b8-4293-9d37-3477d5ab9181 => generated 1361 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:33:09.994956 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-f462a175-308c-49e1-ac1a-883b6cd4e8d6 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:09.995642 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-f462a175-308c-49e1-ac1a-883b6cd4e8d6 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: c01ec91b-c3b8-4293-9d37-3477d5ab9181] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:10.001744 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f462a175-308c-49e1-ac1a-883b6cd4e8d6 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:10.002227 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f462a175-308c-49e1-ac1a-883b6cd4e8d6 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:10.002675 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f462a175-308c-49e1-ac1a-883b6cd4e8d6 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:10.003347 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f462a175-308c-49e1-ac1a-883b6cd4e8d6 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:10.003787 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f462a175-308c-49e1-ac1a-883b6cd4e8d6 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:10.004200 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f462a175-308c-49e1-ac1a-883b6cd4e8d6 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:10.133867 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-f462a175-308c-49e1-ac1a-883b6cd4e8d6 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745deef0124c480cb48ebe7efaea546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f21e0f1dc4c2da5e743e6d01154a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:33:10.141579 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-f462a175-308c-49e1-ac1a-883b6cd4e8d6 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/c01ec91b-c3b8-4293-9d37-3477d5ab9181" status: 200 len: 1547 microversion: 2.1 time: 0.151228 Aug 31 19:33:10.142149 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 602/1205] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:33:09 2022] GET /compute/v2.1/servers/c01ec91b-c3b8-4293-9d37-3477d5ab9181 => generated 1547 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:33:10.161711 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-49287889-9dbd-43ac-b7ec-291c566c1b93 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:10.162260 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-49287889-9dbd-43ac-b7ec-291c566c1b93 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: c01ec91b-c3b8-4293-9d37-3477d5ab9181] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:10.168599 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-49287889-9dbd-43ac-b7ec-291c566c1b93 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:10.169088 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-49287889-9dbd-43ac-b7ec-291c566c1b93 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:10.169557 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-49287889-9dbd-43ac-b7ec-291c566c1b93 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:10.170259 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-49287889-9dbd-43ac-b7ec-291c566c1b93 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:10.170714 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-49287889-9dbd-43ac-b7ec-291c566c1b93 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:10.171135 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-49287889-9dbd-43ac-b7ec-291c566c1b93 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:10.253683 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-49287889-9dbd-43ac-b7ec-291c566c1b93 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/c01ec91b-c3b8-4293-9d37-3477d5ab9181/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096164 Aug 31 19:33:10.254220 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 604/1206] 10.222.0.65 () {58 vars in 1275 bytes} [Wed Aug 31 19:33:10 2022] GET /compute/v2.1/servers/c01ec91b-c3b8-4293-9d37-3477d5ab9181/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:33:11.419090 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-30f8103f-ed82-4c49-b4a7-c6b94cb96b1a req-7572ac81-0b8c-4831-be04-87ee08294967 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c01ec91b-c3b8-4293-9d37-3477d5ab9181", "tag": "8f189730-3f8f-4927-acee-9a6e31849621"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:33:11.425628 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell0:SELECT=6 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:11.432316 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-30f8103f-ed82-4c49-b4a7-c6b94cb96b1a req-7572ac81-0b8c-4831-be04-87ee08294967 service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:11.433235 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-30f8103f-ed82-4c49-b4a7-c6b94cb96b1a req-7572ac81-0b8c-4831-be04-87ee08294967 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:11.433971 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-30f8103f-ed82-4c49-b4a7-c6b94cb96b1a req-7572ac81-0b8c-4831-be04-87ee08294967 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:11.446912 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-30f8103f-ed82-4c49-b4a7-c6b94cb96b1a req-7572ac81-0b8c-4831-be04-87ee08294967 service nova] Creating event network-changed:8f189730-3f8f-4927-acee-9a6e31849621 for instance c01ec91b-c3b8-4293-9d37-3477d5ab9181 on hv-cinder-83538 Aug 31 19:33:11.454586 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-30f8103f-ed82-4c49-b4a7-c6b94cb96b1a req-7572ac81-0b8c-4831-be04-87ee08294967 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039150 Aug 31 19:33:11.455499 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 603/1207] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:34:26.385504 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell0:SELECT=2 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:34:26.386271 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell0:SELECT=6 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:34:26.388865 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:34:26.389544 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=58 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:34:26.445570 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-ad73e9e2-faac-41cb-bda8-c002a50d75a2 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:26.446063 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-ad73e9e2-faac-41cb-bda8-c002a50d75a2 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: c01ec91b-c3b8-4293-9d37-3477d5ab9181] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:26.452154 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ad73e9e2-faac-41cb-bda8-c002a50d75a2 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:26.452578 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ad73e9e2-faac-41cb-bda8-c002a50d75a2 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:26.453008 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ad73e9e2-faac-41cb-bda8-c002a50d75a2 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:26.453726 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ad73e9e2-faac-41cb-bda8-c002a50d75a2 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:26.454178 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ad73e9e2-faac-41cb-bda8-c002a50d75a2 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:26.454597 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ad73e9e2-faac-41cb-bda8-c002a50d75a2 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:26.479978 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-ad73e9e2-faac-41cb-bda8-c002a50d75a2 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/c01ec91b-c3b8-4293-9d37-3477d5ab9181/ips" status: 200 len: 145 microversion: 2.1 time: 0.095790 Aug 31 19:34:26.480529 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 605/1208] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Aug 31 19:34:26 2022] GET /compute/v2.1/servers/c01ec91b-c3b8-4293-9d37-3477d5ab9181/ips => generated 145 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:34:27.802154 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:34:27.803010 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:34:27.808208 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-2f31c195-2d9a-4420-b401-43b6106e50ff tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d656171d-208f-4e74-ae67-c5f86255f34d"}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:34:27.810640 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-2f31c195-2d9a-4420-b401-43b6106e50ff tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: c01ec91b-c3b8-4293-9d37-3477d5ab9181] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:27.818341 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2f31c195-2d9a-4420-b401-43b6106e50ff tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:27.818827 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2f31c195-2d9a-4420-b401-43b6106e50ff tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:27.819260 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2f31c195-2d9a-4420-b401-43b6106e50ff tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:27.819947 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2f31c195-2d9a-4420-b401-43b6106e50ff tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:27.820398 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2f31c195-2d9a-4420-b401-43b6106e50ff tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:27.820813 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2f31c195-2d9a-4420-b401-43b6106e50ff tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:28.085210 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-2f31c195-2d9a-4420-b401-43b6106e50ff tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "POST /compute/v2.1/servers/c01ec91b-c3b8-4293-9d37-3477d5ab9181/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286364 Aug 31 19:34:28.085864 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 604/1209] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 31 19:34:27 2022] POST /compute/v2.1/servers/c01ec91b-c3b8-4293-9d37-3477d5ab9181/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:34:35.599233 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d04a10d5-cf31-46ab-9f30-044ae4e83928 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:35.601571 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d04a10d5-cf31-46ab-9f30-044ae4e83928 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: c01ec91b-c3b8-4293-9d37-3477d5ab9181] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:35.607961 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d04a10d5-cf31-46ab-9f30-044ae4e83928 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:35.608464 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d04a10d5-cf31-46ab-9f30-044ae4e83928 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:35.608894 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d04a10d5-cf31-46ab-9f30-044ae4e83928 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:35.609600 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d04a10d5-cf31-46ab-9f30-044ae4e83928 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:35.610045 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d04a10d5-cf31-46ab-9f30-044ae4e83928 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:35.610459 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d04a10d5-cf31-46ab-9f30-044ae4e83928 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:35.640179 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-d04a10d5-cf31-46ab-9f30-044ae4e83928 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/c01ec91b-c3b8-4293-9d37-3477d5ab9181/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044878 Aug 31 19:34:35.640721 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 606/1210] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 31 19:34:35 2022] GET /compute/v2.1/servers/c01ec91b-c3b8-4293-9d37-3477d5ab9181/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:34:35.652235 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-45f1f367-1514-4ca6-8ce5-a049d5b934a1 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:35.652814 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-45f1f367-1514-4ca6-8ce5-a049d5b934a1 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: c01ec91b-c3b8-4293-9d37-3477d5ab9181] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:35.658926 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-45f1f367-1514-4ca6-8ce5-a049d5b934a1 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:35.659403 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-45f1f367-1514-4ca6-8ce5-a049d5b934a1 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:35.659839 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-45f1f367-1514-4ca6-8ce5-a049d5b934a1 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:35.660524 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-45f1f367-1514-4ca6-8ce5-a049d5b934a1 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:35.660999 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-45f1f367-1514-4ca6-8ce5-a049d5b934a1 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:35.661446 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-45f1f367-1514-4ca6-8ce5-a049d5b934a1 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:35.689805 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-45f1f367-1514-4ca6-8ce5-a049d5b934a1 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/c01ec91b-c3b8-4293-9d37-3477d5ab9181/os-volume_attachments/d656171d-208f-4e74-ae67-c5f86255f34d" status: 200 len: 194 microversion: 2.1 time: 0.042389 Aug 31 19:34:35.690375 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 605/1211] 10.222.0.65 () {58 vars in 1413 bytes} [Wed Aug 31 19:34:35 2022] GET /compute/v2.1/servers/c01ec91b-c3b8-4293-9d37-3477d5ab9181/os-volume_attachments/d656171d-208f-4e74-ae67-c5f86255f34d => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:34:37.014983 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-ef556cb9-bc1b-47b8-8032-1ab49d4bc3be tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "83c1b133-61b7-49d1-ad21-50165292def0"}} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:34:37.017359 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-ef556cb9-bc1b-47b8-8032-1ab49d4bc3be tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: c01ec91b-c3b8-4293-9d37-3477d5ab9181] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:37.024331 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ef556cb9-bc1b-47b8-8032-1ab49d4bc3be tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:37.024819 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ef556cb9-bc1b-47b8-8032-1ab49d4bc3be tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:37.025287 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ef556cb9-bc1b-47b8-8032-1ab49d4bc3be tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:37.025981 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ef556cb9-bc1b-47b8-8032-1ab49d4bc3be tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:37.026434 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ef556cb9-bc1b-47b8-8032-1ab49d4bc3be tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:37.026866 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ef556cb9-bc1b-47b8-8032-1ab49d4bc3be tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:37.402173 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-ef556cb9-bc1b-47b8-8032-1ab49d4bc3be tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "POST /compute/v2.1/servers/c01ec91b-c3b8-4293-9d37-3477d5ab9181/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.390965 Aug 31 19:34:37.405117 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 607/1212] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 31 19:34:37 2022] POST /compute/v2.1/servers/c01ec91b-c3b8-4293-9d37-3477d5ab9181/os-volume_attachments => generated 194 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:34:44.915032 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-ec9643cf-9c6c-4402-858e-e18a18c64228 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:44.917312 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-ec9643cf-9c6c-4402-858e-e18a18c64228 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: c01ec91b-c3b8-4293-9d37-3477d5ab9181] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:44.923716 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ec9643cf-9c6c-4402-858e-e18a18c64228 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:44.924193 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ec9643cf-9c6c-4402-858e-e18a18c64228 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:44.924619 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ec9643cf-9c6c-4402-858e-e18a18c64228 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:44.925330 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ec9643cf-9c6c-4402-858e-e18a18c64228 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:44.925796 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ec9643cf-9c6c-4402-858e-e18a18c64228 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:44.926196 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ec9643cf-9c6c-4402-858e-e18a18c64228 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:44.956256 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-ec9643cf-9c6c-4402-858e-e18a18c64228 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/c01ec91b-c3b8-4293-9d37-3477d5ab9181/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045692 Aug 31 19:34:44.956787 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 606/1213] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 31 19:34:44 2022] GET /compute/v2.1/servers/c01ec91b-c3b8-4293-9d37-3477d5ab9181/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:34:45.103254 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-98a48cd4-49d9-4d02-aa3c-c45ed11c5a70 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:45.103800 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-98a48cd4-49d9-4d02-aa3c-c45ed11c5a70 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: c01ec91b-c3b8-4293-9d37-3477d5ab9181] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:45.110460 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-98a48cd4-49d9-4d02-aa3c-c45ed11c5a70 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:45.110944 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-98a48cd4-49d9-4d02-aa3c-c45ed11c5a70 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:45.111372 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-98a48cd4-49d9-4d02-aa3c-c45ed11c5a70 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:45.112056 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-98a48cd4-49d9-4d02-aa3c-c45ed11c5a70 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:45.112508 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-98a48cd4-49d9-4d02-aa3c-c45ed11c5a70 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:45.112925 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-98a48cd4-49d9-4d02-aa3c-c45ed11c5a70 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:45.141453 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-98a48cd4-49d9-4d02-aa3c-c45ed11c5a70 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/c01ec91b-c3b8-4293-9d37-3477d5ab9181/os-volume_attachments/d656171d-208f-4e74-ae67-c5f86255f34d" status: 200 len: 194 microversion: 2.1 time: 0.043698 Aug 31 19:34:45.142019 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 608/1214] 10.222.0.65 () {58 vars in 1413 bytes} [Wed Aug 31 19:34:45 2022] GET /compute/v2.1/servers/c01ec91b-c3b8-4293-9d37-3477d5ab9181/os-volume_attachments/d656171d-208f-4e74-ae67-c5f86255f34d => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:34:45.152091 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-14253dca-befe-4543-ab43-42b3d2851f51 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:45.152634 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-14253dca-befe-4543-ab43-42b3d2851f51 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: c01ec91b-c3b8-4293-9d37-3477d5ab9181] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:45.158532 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-14253dca-befe-4543-ab43-42b3d2851f51 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:45.159012 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-14253dca-befe-4543-ab43-42b3d2851f51 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:45.159442 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-14253dca-befe-4543-ab43-42b3d2851f51 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:45.160124 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-14253dca-befe-4543-ab43-42b3d2851f51 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:45.160576 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-14253dca-befe-4543-ab43-42b3d2851f51 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:45.160999 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-14253dca-befe-4543-ab43-42b3d2851f51 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:45.245661 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.objects.instance [None req-14253dca-befe-4543-ab43-42b3d2851f51 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lazy-loading 'services' on Instance uuid c01ec91b-c3b8-4293-9d37-3477d5ab9181 {{(pid=120624) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:34:45.315371 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-14253dca-befe-4543-ab43-42b3d2851f51 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "DELETE /compute/v2.1/servers/c01ec91b-c3b8-4293-9d37-3477d5ab9181/os-volume_attachments/d656171d-208f-4e74-ae67-c5f86255f34d" status: 202 len: 0 microversion: 2.1 time: 0.167054 Aug 31 19:34:45.316159 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 607/1215] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Aug 31 19:34:45 2022] DELETE /compute/v2.1/servers/c01ec91b-c3b8-4293-9d37-3477d5ab9181/os-volume_attachments/d656171d-208f-4e74-ae67-c5f86255f34d => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:34:47.489791 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-64bca444-4d25-42a5-965f-db1d58d3a0df tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:47.490309 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-64bca444-4d25-42a5-965f-db1d58d3a0df tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: c01ec91b-c3b8-4293-9d37-3477d5ab9181] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:47.496788 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-64bca444-4d25-42a5-965f-db1d58d3a0df tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:47.497310 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-64bca444-4d25-42a5-965f-db1d58d3a0df tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:47.497748 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-64bca444-4d25-42a5-965f-db1d58d3a0df tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:47.498434 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-64bca444-4d25-42a5-965f-db1d58d3a0df tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:47.498889 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-64bca444-4d25-42a5-965f-db1d58d3a0df tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:47.499314 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-64bca444-4d25-42a5-965f-db1d58d3a0df tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:47.528332 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-64bca444-4d25-42a5-965f-db1d58d3a0df tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/c01ec91b-c3b8-4293-9d37-3477d5ab9181/os-volume_attachments/83c1b133-61b7-49d1-ad21-50165292def0" status: 200 len: 194 microversion: 2.1 time: 0.042598 Aug 31 19:34:47.528909 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 609/1216] 10.222.0.65 () {58 vars in 1413 bytes} [Wed Aug 31 19:34:47 2022] GET /compute/v2.1/servers/c01ec91b-c3b8-4293-9d37-3477d5ab9181/os-volume_attachments/83c1b133-61b7-49d1-ad21-50165292def0 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:34:47.541261 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-4be61684-b117-4db6-932c-6fead5512023 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:47.541831 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-4be61684-b117-4db6-932c-6fead5512023 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: c01ec91b-c3b8-4293-9d37-3477d5ab9181] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:47.548008 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4be61684-b117-4db6-932c-6fead5512023 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:47.548479 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4be61684-b117-4db6-932c-6fead5512023 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:47.548903 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4be61684-b117-4db6-932c-6fead5512023 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:47.549599 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4be61684-b117-4db6-932c-6fead5512023 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:47.550043 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4be61684-b117-4db6-932c-6fead5512023 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:47.550454 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4be61684-b117-4db6-932c-6fead5512023 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:47.632489 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.objects.instance [None req-4be61684-b117-4db6-932c-6fead5512023 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lazy-loading 'services' on Instance uuid c01ec91b-c3b8-4293-9d37-3477d5ab9181 {{(pid=120624) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:34:47.708856 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-4be61684-b117-4db6-932c-6fead5512023 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "DELETE /compute/v2.1/servers/c01ec91b-c3b8-4293-9d37-3477d5ab9181/os-volume_attachments/83c1b133-61b7-49d1-ad21-50165292def0" status: 202 len: 0 microversion: 2.1 time: 0.173251 Aug 31 19:34:47.709471 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 608/1217] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Aug 31 19:34:47 2022] DELETE /compute/v2.1/servers/c01ec91b-c3b8-4293-9d37-3477d5ab9181/os-volume_attachments/83c1b133-61b7-49d1-ad21-50165292def0 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:34:48.875541 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-f3150ed7-804b-4d19-979d-7faa8a87e10b tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:48.877720 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-f3150ed7-804b-4d19-979d-7faa8a87e10b tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: c01ec91b-c3b8-4293-9d37-3477d5ab9181] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:48.884548 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f3150ed7-804b-4d19-979d-7faa8a87e10b tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:48.885037 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f3150ed7-804b-4d19-979d-7faa8a87e10b tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:48.885511 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f3150ed7-804b-4d19-979d-7faa8a87e10b tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:48.886204 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f3150ed7-804b-4d19-979d-7faa8a87e10b tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:48.886686 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f3150ed7-804b-4d19-979d-7faa8a87e10b tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:48.887108 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f3150ed7-804b-4d19-979d-7faa8a87e10b tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:48.915650 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-f3150ed7-804b-4d19-979d-7faa8a87e10b tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/c01ec91b-c3b8-4293-9d37-3477d5ab9181/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044019 Aug 31 19:34:48.916195 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 610/1218] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 31 19:34:48 2022] GET /compute/v2.1/servers/c01ec91b-c3b8-4293-9d37-3477d5ab9181/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 19:34:49.026388 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-1a2266f4-0bc9-464e-a9fd-4c9d1793485f tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:49.028634 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-1a2266f4-0bc9-464e-a9fd-4c9d1793485f tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: c01ec91b-c3b8-4293-9d37-3477d5ab9181] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:49.034783 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1a2266f4-0bc9-464e-a9fd-4c9d1793485f tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:49.035265 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1a2266f4-0bc9-464e-a9fd-4c9d1793485f tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:49.035701 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1a2266f4-0bc9-464e-a9fd-4c9d1793485f tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:49.036386 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1a2266f4-0bc9-464e-a9fd-4c9d1793485f tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:49.036957 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1a2266f4-0bc9-464e-a9fd-4c9d1793485f tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:49.037414 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1a2266f4-0bc9-464e-a9fd-4c9d1793485f tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:49.065784 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-1a2266f4-0bc9-464e-a9fd-4c9d1793485f tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/c01ec91b-c3b8-4293-9d37-3477d5ab9181/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044794 Aug 31 19:34:49.066333 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 609/1219] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 31 19:34:49 2022] GET /compute/v2.1/servers/c01ec91b-c3b8-4293-9d37-3477d5ab9181/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 19:34:49.126528 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-ddd6becf-a5d4-46c7-9814-9857e975b908 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:49.127018 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-ddd6becf-a5d4-46c7-9814-9857e975b908 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: c01ec91b-c3b8-4293-9d37-3477d5ab9181] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:49.133550 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ddd6becf-a5d4-46c7-9814-9857e975b908 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:49.134040 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ddd6becf-a5d4-46c7-9814-9857e975b908 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:49.134476 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ddd6becf-a5d4-46c7-9814-9857e975b908 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:49.135167 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ddd6becf-a5d4-46c7-9814-9857e975b908 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:49.135623 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ddd6becf-a5d4-46c7-9814-9857e975b908 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:49.136048 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ddd6becf-a5d4-46c7-9814-9857e975b908 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:49.160380 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-ddd6becf-a5d4-46c7-9814-9857e975b908 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: c01ec91b-c3b8-4293-9d37-3477d5ab9181] Going to try to terminate instance {{(pid=120623) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 19:34:49.236877 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-ddd6becf-a5d4-46c7-9814-9857e975b908 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "DELETE /compute/v2.1/servers/c01ec91b-c3b8-4293-9d37-3477d5ab9181" status: 204 len: 0 microversion: 2.1 time: 0.113665 Aug 31 19:34:49.237498 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 611/1220] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 31 19:34:49 2022] DELETE /compute/v2.1/servers/c01ec91b-c3b8-4293-9d37-3477d5ab9181 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:34:49.246247 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-b68d7263-3947-4df6-9f77-6703c116aa73 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:49.246852 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-b68d7263-3947-4df6-9f77-6703c116aa73 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: c01ec91b-c3b8-4293-9d37-3477d5ab9181] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:49.252697 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b68d7263-3947-4df6-9f77-6703c116aa73 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:49.253177 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b68d7263-3947-4df6-9f77-6703c116aa73 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:49.253642 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b68d7263-3947-4df6-9f77-6703c116aa73 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:49.254323 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b68d7263-3947-4df6-9f77-6703c116aa73 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:49.254773 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b68d7263-3947-4df6-9f77-6703c116aa73 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:49.255196 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b68d7263-3947-4df6-9f77-6703c116aa73 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:49.389620 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-b68d7263-3947-4df6-9f77-6703c116aa73 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745deef0124c480cb48ebe7efaea546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f21e0f1dc4c2da5e743e6d01154a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:49.397878 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-b68d7263-3947-4df6-9f77-6703c116aa73 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/c01ec91b-c3b8-4293-9d37-3477d5ab9181" status: 200 len: 1671 microversion: 2.1 time: 0.155531 Aug 31 19:34:49.398421 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 610/1221] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:34:49 2022] GET /compute/v2.1/servers/c01ec91b-c3b8-4293-9d37-3477d5ab9181 => generated 1671 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:34:50.419644 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e98a3cc0-d9d4-47bb-b411-4fee70aeca18 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:50.420333 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-e98a3cc0-d9d4-47bb-b411-4fee70aeca18 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: c01ec91b-c3b8-4293-9d37-3477d5ab9181] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:50.426615 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e98a3cc0-d9d4-47bb-b411-4fee70aeca18 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:50.427087 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e98a3cc0-d9d4-47bb-b411-4fee70aeca18 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:50.428148 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e98a3cc0-d9d4-47bb-b411-4fee70aeca18 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:50.428820 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e98a3cc0-d9d4-47bb-b411-4fee70aeca18 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:50.429291 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e98a3cc0-d9d4-47bb-b411-4fee70aeca18 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:50.429710 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e98a3cc0-d9d4-47bb-b411-4fee70aeca18 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:50.560579 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e98a3cc0-d9d4-47bb-b411-4fee70aeca18 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745deef0124c480cb48ebe7efaea546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f21e0f1dc4c2da5e743e6d01154a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:50.568278 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-e98a3cc0-d9d4-47bb-b411-4fee70aeca18 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/c01ec91b-c3b8-4293-9d37-3477d5ab9181" status: 200 len: 1671 microversion: 2.1 time: 0.152899 Aug 31 19:34:50.568830 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 612/1222] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:34:50 2022] GET /compute/v2.1/servers/c01ec91b-c3b8-4293-9d37-3477d5ab9181 => generated 1671 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:34:51.589427 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-b79d49bb-f243-4221-a9ac-69d18ec43647 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:51.590109 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-b79d49bb-f243-4221-a9ac-69d18ec43647 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: c01ec91b-c3b8-4293-9d37-3477d5ab9181] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:51.597124 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b79d49bb-f243-4221-a9ac-69d18ec43647 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:51.597636 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b79d49bb-f243-4221-a9ac-69d18ec43647 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:51.598065 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b79d49bb-f243-4221-a9ac-69d18ec43647 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:51.598748 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b79d49bb-f243-4221-a9ac-69d18ec43647 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:51.599208 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b79d49bb-f243-4221-a9ac-69d18ec43647 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:51.599707 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b79d49bb-f243-4221-a9ac-69d18ec43647 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:51.807468 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-b79d49bb-f243-4221-a9ac-69d18ec43647 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745deef0124c480cb48ebe7efaea546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f21e0f1dc4c2da5e743e6d01154a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:51.815393 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-b79d49bb-f243-4221-a9ac-69d18ec43647 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/c01ec91b-c3b8-4293-9d37-3477d5ab9181" status: 200 len: 1671 microversion: 2.1 time: 0.230107 Aug 31 19:34:51.815957 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 611/1223] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:34:51 2022] GET /compute/v2.1/servers/c01ec91b-c3b8-4293-9d37-3477d5ab9181 => generated 1671 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:34:52.207170 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-4df07be6-ccde-4d1e-977f-53227e3c527b req-e89274e3-a96e-4081-8e5d-ec0ca07f5b54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c01ec91b-c3b8-4293-9d37-3477d5ab9181", "name": "network-vif-deleted", "tag": "8f189730-3f8f-4927-acee-9a6e31849621"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:34:52.218879 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-4df07be6-ccde-4d1e-977f-53227e3c527b req-e89274e3-a96e-4081-8e5d-ec0ca07f5b54 service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:52.219357 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-4df07be6-ccde-4d1e-977f-53227e3c527b req-e89274e3-a96e-4081-8e5d-ec0ca07f5b54 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:52.219795 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-4df07be6-ccde-4d1e-977f-53227e3c527b req-e89274e3-a96e-4081-8e5d-ec0ca07f5b54 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:52.233980 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-4df07be6-ccde-4d1e-977f-53227e3c527b req-e89274e3-a96e-4081-8e5d-ec0ca07f5b54 service nova] Creating event network-vif-deleted:8f189730-3f8f-4927-acee-9a6e31849621 for instance c01ec91b-c3b8-4293-9d37-3477d5ab9181 on hv-cinder-83538 Aug 31 19:34:52.241133 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-4df07be6-ccde-4d1e-977f-53227e3c527b req-e89274e3-a96e-4081-8e5d-ec0ca07f5b54 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036360 Aug 31 19:34:52.241902 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 613/1224] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:34:52.837058 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-6915cd37-c85f-4cd3-8a8e-19ef4124db7d tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:52.837713 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-6915cd37-c85f-4cd3-8a8e-19ef4124db7d tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: c01ec91b-c3b8-4293-9d37-3477d5ab9181] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:52.844663 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6915cd37-c85f-4cd3-8a8e-19ef4124db7d tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:52.845151 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6915cd37-c85f-4cd3-8a8e-19ef4124db7d tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:52.845609 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6915cd37-c85f-4cd3-8a8e-19ef4124db7d tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:52.846311 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6915cd37-c85f-4cd3-8a8e-19ef4124db7d tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:52.846760 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6915cd37-c85f-4cd3-8a8e-19ef4124db7d tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:52.847178 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6915cd37-c85f-4cd3-8a8e-19ef4124db7d tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:52.862240 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.wsgi [None req-6915cd37-c85f-4cd3-8a8e-19ef4124db7d tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] HTTP exception thrown: Instance c01ec91b-c3b8-4293-9d37-3477d5ab9181 could not be found. Aug 31 19:34:52.863879 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-6915cd37-c85f-4cd3-8a8e-19ef4124db7d tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Request method failure captured: Aug 31 19:34:52.863879 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: request: GET /compute/v2.1/servers/c01ec91b-c3b8-4293-9d37-3477d5ab9181 HTTP/1.1 Aug 31 19:34:52.863879 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept: application/json Aug 31 19:34:52.863879 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Aug 31 19:34:52.863879 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Connection: close Aug 31 19:34:52.863879 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Length: 0 Aug 31 19:34:52.863879 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Type: application/json Aug 31 19:34:52.863879 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Host: 10.222.0.65 Aug 31 19:34:52.863879 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Aug 31 19:34:52.863879 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Aug 31 19:34:52.863879 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjD7ZbyJIrkC7jTEetAocjTXYnUQDJtpcjcnTmtXzp-TMfsu94L8htxusF6kVO2IQRczDu2oNyhGpo2Ej4QD5PqZNi1z_KqyslihxrQjAuowWigjE_8bQnnMpA2QcGPnfBHidZX315IT8IHLnjHQMQ6qhSWASvUlsCN23NN3tVsEPzM0Q Aug 31 19:34:52.863879 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Aug 31 19:34:52.863879 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Aug 31 19:34:52.863879 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Aug 31 19:34:52.863879 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Aug 31 19:34:52.863879 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Aug 31 19:34:52.863879 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Aug 31 19:34:52.863879 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Id: 548f21e0f1dc4c2da5e743e6d01154a3 Aug 31 19:34:52.863879 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-AttachVolumeTestJSON-1921002876 Aug 31 19:34:52.863879 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Role: member,reader Aug 31 19:34:52.863879 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Roles: member,reader Aug 31 19:34:52.866002 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/548f21e0f1dc4c2da5e743e6d01154a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/548f21e0f1dc4c2da5e743e6d01154a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_548f21e0f1dc4c2da5e743e6d01154a3", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/548f21e0f1dc4c2da5e743e6d01154a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:34:52.866002 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-AttachVolumeTestJSON-1921002876 Aug 31 19:34:52.866002 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Id: 548f21e0f1dc4c2da5e743e6d01154a3 Aug 31 19:34:52.866002 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1921002876 Aug 31 19:34:52.866002 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User: tempest-AttachVolumeTestJSON-1921002876-project Aug 31 19:34:52.866002 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Aug 31 19:34:52.866002 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Aug 31 19:34:52.866002 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Id: 745deef0124c480cb48ebe7efaea546a Aug 31 19:34:52.866002 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-AttachVolumeTestJSON-1921002876-project Aug 31 19:34:52.866002 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: method: > Aug 31 19:34:52.866002 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: exception: Instance c01ec91b-c3b8-4293-9d37-3477d5ab9181 could not be found. Aug 31 19:34:52.866002 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: action_args: {'id': 'c01ec91b-c3b8-4293-9d37-3477d5ab9181'} Aug 31 19:34:52.867175 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:34:52.867175 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:34:52.867175 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:34:52.867175 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:34:52.867175 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:34:52.867175 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:34:52.867175 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:34:52.867175 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:34:52.867175 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:34:52.867175 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:34:52.867175 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c01ec91b-c3b8-4293-9d37-3477d5ab9181 could not be found. Aug 31 19:34:52.867175 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:34:52.867175 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:34:52.867175 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:34:52.867175 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:34:52.867175 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:34:52.867175 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:34:52.867175 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:34:52.867175 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:34:52.867175 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:34:52.868632 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:34:52.868632 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:34:52.868632 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:34:52.868632 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:34:52.868632 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:34:52.868632 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:34:52.868632 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:34:52.868632 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c01ec91b-c3b8-4293-9d37-3477d5ab9181 could not be found. Aug 31 19:34:52.868632 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:34:52.868632 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:34:52.868632 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:34:52.868632 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:34:52.868632 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:34:52.868632 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:34:52.868632 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:34:52.868632 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:34:52.868632 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c01ec91b-c3b8-4293-9d37-3477d5ab9181 could not be found. Aug 31 19:34:52.868632 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:34:52.869925 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-6915cd37-c85f-4cd3-8a8e-19ef4124db7d tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Returning 404 to user: Instance c01ec91b-c3b8-4293-9d37-3477d5ab9181 could not be found. {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:34:52.869925 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-6915cd37-c85f-4cd3-8a8e-19ef4124db7d tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/c01ec91b-c3b8-4293-9d37-3477d5ab9181" status: 404 len: 111 microversion: 2.1 time: 0.033042 Aug 31 19:34:52.869925 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 612/1225] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:34:52 2022] GET /compute/v2.1/servers/c01ec91b-c3b8-4293-9d37-3477d5ab9181 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:34:52.875347 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-68e36e3b-6147-4560-93ed-63a271bfa274 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '.version_select at 0x7fdb86175670>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:52.895871 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-68e36e3b-6147-4560-93ed-63a271bfa274 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-93426680" status: 202 len: 0 microversion: 2.1 time: 0.024606 Aug 31 19:34:52.900055 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 614/1226] 10.222.0.65 () {58 vars in 1215 bytes} [Wed Aug 31 19:34:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-93426680 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:34:55.792947 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-b794c6ce-f8cc-43ec-ac82-b10856dc1a7e tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:55.793500 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-b794c6ce-f8cc-43ec-ac82-b10856dc1a7e tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: c01ec91b-c3b8-4293-9d37-3477d5ab9181] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:55.799743 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b794c6ce-f8cc-43ec-ac82-b10856dc1a7e tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:55.800223 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b794c6ce-f8cc-43ec-ac82-b10856dc1a7e tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:55.800940 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b794c6ce-f8cc-43ec-ac82-b10856dc1a7e tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:55.801666 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b794c6ce-f8cc-43ec-ac82-b10856dc1a7e tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:55.802115 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b794c6ce-f8cc-43ec-ac82-b10856dc1a7e tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:55.802531 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b794c6ce-f8cc-43ec-ac82-b10856dc1a7e tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:55.816279 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.wsgi [None req-b794c6ce-f8cc-43ec-ac82-b10856dc1a7e tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] HTTP exception thrown: Instance c01ec91b-c3b8-4293-9d37-3477d5ab9181 could not be found. Aug 31 19:34:55.818164 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-b794c6ce-f8cc-43ec-ac82-b10856dc1a7e tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Request method failure captured: Aug 31 19:34:55.818164 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: request: DELETE /compute/v2.1/servers/c01ec91b-c3b8-4293-9d37-3477d5ab9181 HTTP/1.1 Aug 31 19:34:55.818164 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept: application/json Aug 31 19:34:55.818164 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Aug 31 19:34:55.818164 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Connection: close Aug 31 19:34:55.818164 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Length: 0 Aug 31 19:34:55.818164 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Type: application/json Aug 31 19:34:55.818164 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Host: 10.222.0.65 Aug 31 19:34:55.818164 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Aug 31 19:34:55.818164 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Aug 31 19:34:55.818164 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjD7ZbyJIrkC7jTEetAocjTXYnUQDJtpcjcnTmtXzp-TMfsu94L8htxusF6kVO2IQRczDu2oNyhGpo2Ej4QD5PqZNi1z_KqyslihxrQjAuowWigjE_8bQnnMpA2QcGPnfBHidZX315IT8IHLnjHQMQ6qhSWASvUlsCN23NN3tVsEPzM0Q Aug 31 19:34:55.818164 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Aug 31 19:34:55.818164 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Aug 31 19:34:55.818164 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Aug 31 19:34:55.818164 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Aug 31 19:34:55.818164 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Aug 31 19:34:55.818164 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Aug 31 19:34:55.818164 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Id: 548f21e0f1dc4c2da5e743e6d01154a3 Aug 31 19:34:55.818164 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-AttachVolumeTestJSON-1921002876 Aug 31 19:34:55.818164 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Role: member,reader Aug 31 19:34:55.818164 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Roles: member,reader Aug 31 19:34:55.820508 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/548f21e0f1dc4c2da5e743e6d01154a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/548f21e0f1dc4c2da5e743e6d01154a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_548f21e0f1dc4c2da5e743e6d01154a3", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/548f21e0f1dc4c2da5e743e6d01154a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:34:55.820508 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-AttachVolumeTestJSON-1921002876 Aug 31 19:34:55.820508 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Id: 548f21e0f1dc4c2da5e743e6d01154a3 Aug 31 19:34:55.820508 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1921002876 Aug 31 19:34:55.820508 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User: tempest-AttachVolumeTestJSON-1921002876-project Aug 31 19:34:55.820508 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Aug 31 19:34:55.820508 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Aug 31 19:34:55.820508 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Id: 745deef0124c480cb48ebe7efaea546a Aug 31 19:34:55.820508 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-AttachVolumeTestJSON-1921002876-project Aug 31 19:34:55.820508 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: method: > Aug 31 19:34:55.820508 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: exception: Instance c01ec91b-c3b8-4293-9d37-3477d5ab9181 could not be found. Aug 31 19:34:55.820508 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: action_args: {'id': 'c01ec91b-c3b8-4293-9d37-3477d5ab9181'} Aug 31 19:34:55.821513 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:34:55.821513 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:34:55.821513 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:34:55.821513 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:34:55.821513 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:34:55.821513 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:34:55.821513 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:34:55.821513 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:34:55.821513 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:34:55.821513 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:34:55.821513 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c01ec91b-c3b8-4293-9d37-3477d5ab9181 could not be found. Aug 31 19:34:55.821513 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:34:55.821513 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:34:55.821513 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:34:55.821513 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:34:55.821513 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:34:55.821513 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:34:55.821513 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:34:55.821513 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:34:55.821513 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:34:55.823081 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:34:55.823081 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 19:34:55.823081 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 19:34:55.823081 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 19:34:55.823081 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 19:34:55.823081 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:34:55.823081 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:34:55.823081 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:34:55.823081 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:34:55.823081 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c01ec91b-c3b8-4293-9d37-3477d5ab9181 could not be found. Aug 31 19:34:55.823081 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:34:55.823081 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:34:55.823081 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:34:55.823081 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:34:55.823081 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:34:55.823081 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:34:55.823081 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:34:55.823081 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:34:55.823081 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c01ec91b-c3b8-4293-9d37-3477d5ab9181 could not be found. Aug 31 19:34:55.823081 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:34:55.824701 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-b794c6ce-f8cc-43ec-ac82-b10856dc1a7e tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Returning 404 to user: Instance c01ec91b-c3b8-4293-9d37-3477d5ab9181 could not be found. {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:34:55.824701 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-b794c6ce-f8cc-43ec-ac82-b10856dc1a7e tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "DELETE /compute/v2.1/servers/c01ec91b-c3b8-4293-9d37-3477d5ab9181" status: 404 len: 111 microversion: 2.1 time: 0.031065 Aug 31 19:34:55.824701 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 613/1227] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 31 19:34:55 2022] DELETE /compute/v2.1/servers/c01ec91b-c3b8-4293-9d37-3477d5ab9181 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:34:55.828562 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-0e199ed2-1915-4abf-95a8-8c7a07933e0f tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:55.829327 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-0e199ed2-1915-4abf-95a8-8c7a07933e0f tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: c01ec91b-c3b8-4293-9d37-3477d5ab9181] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:55.835906 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0e199ed2-1915-4abf-95a8-8c7a07933e0f tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:55.836387 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0e199ed2-1915-4abf-95a8-8c7a07933e0f tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:55.836822 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0e199ed2-1915-4abf-95a8-8c7a07933e0f tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:55.837551 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0e199ed2-1915-4abf-95a8-8c7a07933e0f tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:55.838267 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0e199ed2-1915-4abf-95a8-8c7a07933e0f tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:55.838695 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0e199ed2-1915-4abf-95a8-8c7a07933e0f tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:55.853422 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.wsgi [None req-0e199ed2-1915-4abf-95a8-8c7a07933e0f tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] HTTP exception thrown: Instance c01ec91b-c3b8-4293-9d37-3477d5ab9181 could not be found. Aug 31 19:34:55.855068 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-0e199ed2-1915-4abf-95a8-8c7a07933e0f tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Request method failure captured: Aug 31 19:34:55.855068 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: request: GET /compute/v2.1/servers/c01ec91b-c3b8-4293-9d37-3477d5ab9181 HTTP/1.1 Aug 31 19:34:55.855068 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Accept: application/json Aug 31 19:34:55.855068 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Accept-Encoding: identity Aug 31 19:34:55.855068 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Connection: close Aug 31 19:34:55.855068 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Content-Length: 0 Aug 31 19:34:55.855068 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Content-Type: application/json Aug 31 19:34:55.855068 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Host: 10.222.0.65 Aug 31 19:34:55.855068 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Openstack-System-Scope: None Aug 31 19:34:55.855068 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: User-Agent: python-urllib3/1.26.12 Aug 31 19:34:55.855068 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Auth-Token: gAAAAABjD7ZbyJIrkC7jTEetAocjTXYnUQDJtpcjcnTmtXzp-TMfsu94L8htxusF6kVO2IQRczDu2oNyhGpo2Ej4QD5PqZNi1z_KqyslihxrQjAuowWigjE_8bQnnMpA2QcGPnfBHidZX315IT8IHLnjHQMQ6qhSWASvUlsCN23NN3tVsEPzM0Q Aug 31 19:34:55.855068 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Domain-Id: None Aug 31 19:34:55.855068 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Domain-Name: None Aug 31 19:34:55.855068 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Identity-Status: Confirmed Aug 31 19:34:55.855068 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Is-Admin-Project: True Aug 31 19:34:55.855068 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Id: default Aug 31 19:34:55.855068 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Name: Default Aug 31 19:34:55.855068 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Id: 548f21e0f1dc4c2da5e743e6d01154a3 Aug 31 19:34:55.855068 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Name: tempest-AttachVolumeTestJSON-1921002876 Aug 31 19:34:55.855068 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Role: member,reader Aug 31 19:34:55.855068 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Roles: member,reader Aug 31 19:34:55.856815 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/548f21e0f1dc4c2da5e743e6d01154a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/548f21e0f1dc4c2da5e743e6d01154a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_548f21e0f1dc4c2da5e743e6d01154a3", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/548f21e0f1dc4c2da5e743e6d01154a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:34:55.856815 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant: tempest-AttachVolumeTestJSON-1921002876 Aug 31 19:34:55.856815 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant-Id: 548f21e0f1dc4c2da5e743e6d01154a3 Aug 31 19:34:55.856815 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1921002876 Aug 31 19:34:55.856815 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User: tempest-AttachVolumeTestJSON-1921002876-project Aug 31 19:34:55.856815 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Id: default Aug 31 19:34:55.856815 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Name: Default Aug 31 19:34:55.856815 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Id: 745deef0124c480cb48ebe7efaea546a Aug 31 19:34:55.856815 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Name: tempest-AttachVolumeTestJSON-1921002876-project Aug 31 19:34:55.856815 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: method: > Aug 31 19:34:55.856815 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: exception: Instance c01ec91b-c3b8-4293-9d37-3477d5ab9181 could not be found. Aug 31 19:34:55.856815 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: action_args: {'id': 'c01ec91b-c3b8-4293-9d37-3477d5ab9181'} Aug 31 19:34:55.857813 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:34:55.857813 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:34:55.857813 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:34:55.857813 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:34:55.857813 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:34:55.857813 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:34:55.857813 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:34:55.857813 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:34:55.857813 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:34:55.857813 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:34:55.857813 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c01ec91b-c3b8-4293-9d37-3477d5ab9181 could not be found. Aug 31 19:34:55.857813 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:34:55.857813 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:34:55.857813 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:34:55.857813 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:34:55.857813 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:34:55.857813 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:34:55.857813 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:34:55.857813 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:34:55.857813 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:34:55.859373 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:34:55.859373 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:34:55.859373 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:34:55.859373 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:34:55.859373 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:34:55.859373 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:34:55.859373 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:34:55.859373 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c01ec91b-c3b8-4293-9d37-3477d5ab9181 could not be found. Aug 31 19:34:55.859373 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:34:55.859373 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:34:55.859373 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:34:55.859373 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:34:55.859373 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:34:55.859373 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:34:55.859373 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:34:55.859373 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:34:55.859373 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c01ec91b-c3b8-4293-9d37-3477d5ab9181 could not be found. Aug 31 19:34:55.859373 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:34:55.860743 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-0e199ed2-1915-4abf-95a8-8c7a07933e0f tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Returning 404 to user: Instance c01ec91b-c3b8-4293-9d37-3477d5ab9181 could not be found. {{(pid=120623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:34:55.860743 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-0e199ed2-1915-4abf-95a8-8c7a07933e0f tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/c01ec91b-c3b8-4293-9d37-3477d5ab9181" status: 404 len: 111 microversion: 2.1 time: 0.031689 Aug 31 19:34:55.860743 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 615/1228] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:34:55 2022] GET /compute/v2.1/servers/c01ec91b-c3b8-4293-9d37-3477d5ab9181 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 19:34:56.992907 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-8c2c1bd8-7d9c-473c-9f13-5a34078bc032 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:56.993497 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-8c2c1bd8-7d9c-473c-9f13-5a34078bc032 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:56.999997 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8c2c1bd8-7d9c-473c-9f13-5a34078bc032 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:57.000470 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8c2c1bd8-7d9c-473c-9f13-5a34078bc032 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:57.000896 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8c2c1bd8-7d9c-473c-9f13-5a34078bc032 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:57.001602 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8c2c1bd8-7d9c-473c-9f13-5a34078bc032 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:57.002048 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8c2c1bd8-7d9c-473c-9f13-5a34078bc032 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:57.002461 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8c2c1bd8-7d9c-473c-9f13-5a34078bc032 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:57.016480 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.wsgi [None req-8c2c1bd8-7d9c-473c-9f13-5a34078bc032 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] HTTP exception thrown: Instance b81447ec-0b34-4911-b4f7-44ade9239065 could not be found. Aug 31 19:34:57.017999 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-8c2c1bd8-7d9c-473c-9f13-5a34078bc032 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Request method failure captured: Aug 31 19:34:57.017999 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: request: DELETE /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065 HTTP/1.1 Aug 31 19:34:57.017999 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept: application/json Aug 31 19:34:57.017999 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Aug 31 19:34:57.017999 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Connection: close Aug 31 19:34:57.017999 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Length: 0 Aug 31 19:34:57.017999 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Type: application/json Aug 31 19:34:57.017999 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Host: 10.222.0.65 Aug 31 19:34:57.017999 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Aug 31 19:34:57.017999 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Aug 31 19:34:57.017999 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjD7ZbyJIrkC7jTEetAocjTXYnUQDJtpcjcnTmtXzp-TMfsu94L8htxusF6kVO2IQRczDu2oNyhGpo2Ej4QD5PqZNi1z_KqyslihxrQjAuowWigjE_8bQnnMpA2QcGPnfBHidZX315IT8IHLnjHQMQ6qhSWASvUlsCN23NN3tVsEPzM0Q Aug 31 19:34:57.017999 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Aug 31 19:34:57.017999 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Aug 31 19:34:57.017999 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Aug 31 19:34:57.017999 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Aug 31 19:34:57.017999 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Aug 31 19:34:57.017999 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Aug 31 19:34:57.017999 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Id: 548f21e0f1dc4c2da5e743e6d01154a3 Aug 31 19:34:57.017999 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-AttachVolumeTestJSON-1921002876 Aug 31 19:34:57.017999 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Role: member,reader Aug 31 19:34:57.017999 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Roles: member,reader Aug 31 19:34:57.019691 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/548f21e0f1dc4c2da5e743e6d01154a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/548f21e0f1dc4c2da5e743e6d01154a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_548f21e0f1dc4c2da5e743e6d01154a3", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/548f21e0f1dc4c2da5e743e6d01154a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:34:57.019691 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-AttachVolumeTestJSON-1921002876 Aug 31 19:34:57.019691 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Id: 548f21e0f1dc4c2da5e743e6d01154a3 Aug 31 19:34:57.019691 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1921002876 Aug 31 19:34:57.019691 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User: tempest-AttachVolumeTestJSON-1921002876-project Aug 31 19:34:57.019691 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Aug 31 19:34:57.019691 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Aug 31 19:34:57.019691 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Id: 745deef0124c480cb48ebe7efaea546a Aug 31 19:34:57.019691 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-AttachVolumeTestJSON-1921002876-project Aug 31 19:34:57.019691 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: method: > Aug 31 19:34:57.019691 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: exception: Instance b81447ec-0b34-4911-b4f7-44ade9239065 could not be found. Aug 31 19:34:57.019691 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: action_args: {'id': 'b81447ec-0b34-4911-b4f7-44ade9239065'} Aug 31 19:34:57.020842 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:34:57.020842 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:34:57.020842 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:34:57.020842 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:34:57.020842 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:34:57.020842 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:34:57.020842 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:34:57.020842 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:34:57.020842 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:34:57.020842 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:34:57.020842 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b81447ec-0b34-4911-b4f7-44ade9239065 could not be found. Aug 31 19:34:57.020842 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:34:57.020842 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:34:57.020842 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:34:57.020842 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:34:57.020842 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:34:57.020842 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:34:57.020842 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:34:57.020842 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:34:57.020842 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:34:57.023269 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:34:57.023269 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 19:34:57.023269 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 19:34:57.023269 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 19:34:57.023269 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 19:34:57.023269 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:34:57.023269 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:34:57.023269 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:34:57.023269 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:34:57.023269 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b81447ec-0b34-4911-b4f7-44ade9239065 could not be found. Aug 31 19:34:57.023269 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:34:57.023269 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:34:57.023269 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:34:57.023269 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:34:57.023269 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:34:57.023269 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:34:57.023269 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:34:57.023269 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:34:57.023269 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b81447ec-0b34-4911-b4f7-44ade9239065 could not be found. Aug 31 19:34:57.023269 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:34:57.025106 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-8c2c1bd8-7d9c-473c-9f13-5a34078bc032 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Returning 404 to user: Instance b81447ec-0b34-4911-b4f7-44ade9239065 could not be found. {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:34:57.025106 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-8c2c1bd8-7d9c-473c-9f13-5a34078bc032 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "DELETE /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065" status: 404 len: 111 microversion: 2.1 time: 0.030365 Aug 31 19:34:57.025106 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 614/1229] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 31 19:34:56 2022] DELETE /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:34:57.028123 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d9a8711e-151a-451e-8c43-f99c67c7d9b2 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:57.028754 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d9a8711e-151a-451e-8c43-f99c67c7d9b2 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] [instance: b81447ec-0b34-4911-b4f7-44ade9239065] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:57.031164 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:34:57.036330 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d9a8711e-151a-451e-8c43-f99c67c7d9b2 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:57.036804 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d9a8711e-151a-451e-8c43-f99c67c7d9b2 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:57.037388 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d9a8711e-151a-451e-8c43-f99c67c7d9b2 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:57.038069 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d9a8711e-151a-451e-8c43-f99c67c7d9b2 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:57.038518 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d9a8711e-151a-451e-8c43-f99c67c7d9b2 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:57.038930 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d9a8711e-151a-451e-8c43-f99c67c7d9b2 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:57.043649 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:34:57.055027 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.wsgi [None req-d9a8711e-151a-451e-8c43-f99c67c7d9b2 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] HTTP exception thrown: Instance b81447ec-0b34-4911-b4f7-44ade9239065 could not be found. Aug 31 19:34:57.056677 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d9a8711e-151a-451e-8c43-f99c67c7d9b2 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Request method failure captured: Aug 31 19:34:57.056677 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: request: GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065 HTTP/1.1 Aug 31 19:34:57.056677 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Accept: application/json Aug 31 19:34:57.056677 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Accept-Encoding: identity Aug 31 19:34:57.056677 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Connection: close Aug 31 19:34:57.056677 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Content-Length: 0 Aug 31 19:34:57.056677 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Content-Type: application/json Aug 31 19:34:57.056677 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Host: 10.222.0.65 Aug 31 19:34:57.056677 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Openstack-System-Scope: None Aug 31 19:34:57.056677 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: User-Agent: python-urllib3/1.26.12 Aug 31 19:34:57.056677 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Auth-Token: gAAAAABjD7ZbyJIrkC7jTEetAocjTXYnUQDJtpcjcnTmtXzp-TMfsu94L8htxusF6kVO2IQRczDu2oNyhGpo2Ej4QD5PqZNi1z_KqyslihxrQjAuowWigjE_8bQnnMpA2QcGPnfBHidZX315IT8IHLnjHQMQ6qhSWASvUlsCN23NN3tVsEPzM0Q Aug 31 19:34:57.056677 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Domain-Id: None Aug 31 19:34:57.056677 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Domain-Name: None Aug 31 19:34:57.056677 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Identity-Status: Confirmed Aug 31 19:34:57.056677 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Is-Admin-Project: True Aug 31 19:34:57.056677 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Id: default Aug 31 19:34:57.056677 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Name: Default Aug 31 19:34:57.056677 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Id: 548f21e0f1dc4c2da5e743e6d01154a3 Aug 31 19:34:57.056677 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Name: tempest-AttachVolumeTestJSON-1921002876 Aug 31 19:34:57.056677 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Role: member,reader Aug 31 19:34:57.056677 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Roles: member,reader Aug 31 19:34:57.058458 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/548f21e0f1dc4c2da5e743e6d01154a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/548f21e0f1dc4c2da5e743e6d01154a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_548f21e0f1dc4c2da5e743e6d01154a3", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/548f21e0f1dc4c2da5e743e6d01154a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:34:57.058458 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant: tempest-AttachVolumeTestJSON-1921002876 Aug 31 19:34:57.058458 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant-Id: 548f21e0f1dc4c2da5e743e6d01154a3 Aug 31 19:34:57.058458 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1921002876 Aug 31 19:34:57.058458 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User: tempest-AttachVolumeTestJSON-1921002876-project Aug 31 19:34:57.058458 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Id: default Aug 31 19:34:57.058458 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Name: Default Aug 31 19:34:57.058458 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Id: 745deef0124c480cb48ebe7efaea546a Aug 31 19:34:57.058458 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Name: tempest-AttachVolumeTestJSON-1921002876-project Aug 31 19:34:57.058458 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: method: > Aug 31 19:34:57.058458 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: exception: Instance b81447ec-0b34-4911-b4f7-44ade9239065 could not be found. Aug 31 19:34:57.058458 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: action_args: {'id': 'b81447ec-0b34-4911-b4f7-44ade9239065'} Aug 31 19:34:57.059647 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:34:57.059647 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:34:57.059647 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:34:57.059647 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:34:57.059647 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:34:57.059647 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:34:57.059647 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:34:57.059647 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:34:57.059647 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:34:57.059647 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:34:57.059647 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b81447ec-0b34-4911-b4f7-44ade9239065 could not be found. Aug 31 19:34:57.059647 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:34:57.059647 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:34:57.059647 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:34:57.059647 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:34:57.059647 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:34:57.059647 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:34:57.059647 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:34:57.059647 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:34:57.059647 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:34:57.061352 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:34:57.061352 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:34:57.061352 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:34:57.061352 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:34:57.061352 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:34:57.061352 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:34:57.061352 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:34:57.061352 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b81447ec-0b34-4911-b4f7-44ade9239065 could not be found. Aug 31 19:34:57.061352 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:34:57.061352 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:34:57.061352 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:34:57.061352 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:34:57.061352 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:34:57.061352 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:34:57.061352 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:34:57.061352 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:34:57.061352 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b81447ec-0b34-4911-b4f7-44ade9239065 could not be found. Aug 31 19:34:57.061352 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:34:57.063059 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d9a8711e-151a-451e-8c43-f99c67c7d9b2 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] Returning 404 to user: Instance b81447ec-0b34-4911-b4f7-44ade9239065 could not be found. {{(pid=120623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:34:57.063059 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-d9a8711e-151a-451e-8c43-f99c67c7d9b2 tempest-AttachVolumeTestJSON-1921002876 tempest-AttachVolumeTestJSON-1921002876-project] 10.222.0.65 "GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065" status: 404 len: 111 microversion: 2.1 time: 0.033714 Aug 31 19:34:57.063059 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 616/1230] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:34:57 2022] GET /compute/v2.1/servers/b81447ec-0b34-4911-b4f7-44ade9239065 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:35:01.392341 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-192fb66b-2212-4126-86a7-87a6e58af498 tempest-VolumesSnapshotsTestJSON-652545629 tempest-VolumesSnapshotsTestJSON-652545629-project] Action: 'create', calling method: .version_select at 0x7fdb86634f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-755297468"}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:35:01.679966 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-192fb66b-2212-4126-86a7-87a6e58af498 tempest-VolumesSnapshotsTestJSON-652545629 tempest-VolumesSnapshotsTestJSON-652545629-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.404696 Aug 31 19:35:01.680577 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 615/1231] 10.222.0.65 () {60 vars in 1155 bytes} [Wed Aug 31 19:35:01 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 406 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 31 19:35:01.693142 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-11e282ee-0340-4334-b7d6-3c47ee460673 tempest-VolumesSnapshotsTestJSON-652545629 tempest-VolumesSnapshotsTestJSON-652545629-project] Calling method '.version_select at 0x7fdb871f9f70>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:01.746231 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-11e282ee-0340-4334-b7d6-3c47ee460673 tempest-VolumesSnapshotsTestJSON-652545629 tempest-VolumesSnapshotsTestJSON-652545629-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/5c26e2be-4700-4b00-b327-3befb449903b" status: 200 len: 344 microversion: 2.1 time: 0.057265 Aug 31 19:35:01.746834 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 617/1232] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 31 19:35:01 2022] GET /compute/v2.1/os-volumes/5c26e2be-4700-4b00-b327-3befb449903b => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:35:02.761542 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-fe7fbc7b-6bc5-4947-a7c3-0f964b1e7da1 tempest-VolumesSnapshotsTestJSON-652545629 tempest-VolumesSnapshotsTestJSON-652545629-project] Calling method '.version_select at 0x7fdb89af5430>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:02.808753 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-fe7fbc7b-6bc5-4947-a7c3-0f964b1e7da1 tempest-VolumesSnapshotsTestJSON-652545629 tempest-VolumesSnapshotsTestJSON-652545629-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/5c26e2be-4700-4b00-b327-3befb449903b" status: 200 len: 345 microversion: 2.1 time: 0.052192 Aug 31 19:35:02.809346 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 616/1233] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 31 19:35:02 2022] GET /compute/v2.1/os-volumes/5c26e2be-4700-4b00-b327-3befb449903b => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:35:02.822738 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-f1933f13-caba-407f-a5bb-edf9888104b8 tempest-VolumesSnapshotsTestJSON-652545629 tempest-VolumesSnapshotsTestJSON-652545629-project] Action: 'create', calling method: .version_select at 0x7fdb86193670>, body: {"snapshot": {"volume_id": "5c26e2be-4700-4b00-b327-3befb449903b", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-791357866"}} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:35:02.970410 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-f1933f13-caba-407f-a5bb-edf9888104b8 tempest-VolumesSnapshotsTestJSON-652545629 tempest-VolumesSnapshotsTestJSON-652545629-project] 10.222.0.65 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.152521 Aug 31 19:35:02.971190 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 618/1234] 10.222.0.65 () {60 vars in 1162 bytes} [Wed Aug 31 19:35:02 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:35:02.982095 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-2d1372e5-30eb-472c-85c7-a2ba142c3700 tempest-VolumesSnapshotsTestJSON-652545629 tempest-VolumesSnapshotsTestJSON-652545629-project] Calling method '.version_select at 0x7fdb86634700>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:03.013424 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-2d1372e5-30eb-472c-85c7-a2ba142c3700 tempest-VolumesSnapshotsTestJSON-652545629 tempest-VolumesSnapshotsTestJSON-652545629-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/31f28acf-f12d-4cff-8056-36d71d0c66a9" status: 200 len: 286 microversion: 2.1 time: 0.035025 Aug 31 19:35:03.013938 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 617/1235] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Aug 31 19:35:02 2022] GET /compute/v2.1/os-snapshots/31f28acf-f12d-4cff-8056-36d71d0c66a9 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:35:03.024990 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-00147f33-baed-46ac-b98f-5c08daf92216 tempest-VolumesSnapshotsTestJSON-652545629 tempest-VolumesSnapshotsTestJSON-652545629-project] Calling method '.version_select at 0x7fdb86175280>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:03.056498 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-00147f33-baed-46ac-b98f-5c08daf92216 tempest-VolumesSnapshotsTestJSON-652545629 tempest-VolumesSnapshotsTestJSON-652545629-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.035693 Aug 31 19:35:03.057055 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 619/1236] 10.222.0.65 () {58 vars in 1140 bytes} [Wed Aug 31 19:35:03 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:35:03.067807 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-d3eb0a9e-5aaa-4f91-9b03-62e9542431a5 tempest-VolumesSnapshotsTestJSON-652545629 tempest-VolumesSnapshotsTestJSON-652545629-project] Calling method '.version_select at 0x7fdb86522d30>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:03.097576 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-d3eb0a9e-5aaa-4f91-9b03-62e9542431a5 tempest-VolumesSnapshotsTestJSON-652545629 tempest-VolumesSnapshotsTestJSON-652545629-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/31f28acf-f12d-4cff-8056-36d71d0c66a9" status: 200 len: 286 microversion: 2.1 time: 0.033536 Aug 31 19:35:03.098151 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 618/1237] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Aug 31 19:35:03 2022] GET /compute/v2.1/os-snapshots/31f28acf-f12d-4cff-8056-36d71d0c66a9 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:35:04.111012 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-8177b6ac-5fe4-4711-ad6b-edba36c90b22 tempest-VolumesSnapshotsTestJSON-652545629 tempest-VolumesSnapshotsTestJSON-652545629-project] Calling method '.version_select at 0x7fdb8668e280>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:04.142075 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-8177b6ac-5fe4-4711-ad6b-edba36c90b22 tempest-VolumesSnapshotsTestJSON-652545629 tempest-VolumesSnapshotsTestJSON-652545629-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/31f28acf-f12d-4cff-8056-36d71d0c66a9" status: 200 len: 286 microversion: 2.1 time: 0.035257 Aug 31 19:35:04.142639 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 620/1238] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Aug 31 19:35:04 2022] GET /compute/v2.1/os-snapshots/31f28acf-f12d-4cff-8056-36d71d0c66a9 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:35:05.155011 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-3a1767ee-0d98-4baf-8f68-0523d7ea46a9 tempest-VolumesSnapshotsTestJSON-652545629 tempest-VolumesSnapshotsTestJSON-652545629-project] Calling method '.version_select at 0x7fdb865345e0>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:05.184216 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-3a1767ee-0d98-4baf-8f68-0523d7ea46a9 tempest-VolumesSnapshotsTestJSON-652545629 tempest-VolumesSnapshotsTestJSON-652545629-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/31f28acf-f12d-4cff-8056-36d71d0c66a9" status: 200 len: 286 microversion: 2.1 time: 0.033462 Aug 31 19:35:05.184761 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 619/1239] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Aug 31 19:35:05 2022] GET /compute/v2.1/os-snapshots/31f28acf-f12d-4cff-8056-36d71d0c66a9 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:35:06.196908 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e8a7a4cd-4797-4b34-a254-2a3583a21fb4 tempest-VolumesSnapshotsTestJSON-652545629 tempest-VolumesSnapshotsTestJSON-652545629-project] Calling method '.version_select at 0x7fdb8619d550>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:06.226826 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-e8a7a4cd-4797-4b34-a254-2a3583a21fb4 tempest-VolumesSnapshotsTestJSON-652545629 tempest-VolumesSnapshotsTestJSON-652545629-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/31f28acf-f12d-4cff-8056-36d71d0c66a9" status: 200 len: 286 microversion: 2.1 time: 0.034339 Aug 31 19:35:06.227389 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 621/1240] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Aug 31 19:35:06 2022] GET /compute/v2.1/os-snapshots/31f28acf-f12d-4cff-8056-36d71d0c66a9 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:35:07.236796 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_api:SELECT=22 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:35:07.237827 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:35:07.242602 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-cabc185f-440a-430b-9481-bbfdeaa5b5db tempest-VolumesSnapshotsTestJSON-652545629 tempest-VolumesSnapshotsTestJSON-652545629-project] Calling method '.version_select at 0x7fdb86634040>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:07.272309 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-cabc185f-440a-430b-9481-bbfdeaa5b5db tempest-VolumesSnapshotsTestJSON-652545629 tempest-VolumesSnapshotsTestJSON-652545629-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/31f28acf-f12d-4cff-8056-36d71d0c66a9" status: 200 len: 287 microversion: 2.1 time: 0.036880 Aug 31 19:35:07.272900 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 620/1241] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Aug 31 19:35:07 2022] GET /compute/v2.1/os-snapshots/31f28acf-f12d-4cff-8056-36d71d0c66a9 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:35:07.280377 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=1 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:35:07.284701 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-48ef66fe-0567-4ca8-8804-a1239df30f33 tempest-VolumesSnapshotsTestJSON-652545629 tempest-VolumesSnapshotsTestJSON-652545629-project] Calling method '.version_select at 0x7fdb8657ed30>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:07.341948 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-48ef66fe-0567-4ca8-8804-a1239df30f33 tempest-VolumesSnapshotsTestJSON-652545629 tempest-VolumesSnapshotsTestJSON-652545629-project] 10.222.0.65 "DELETE /compute/v2.1/os-snapshots/31f28acf-f12d-4cff-8056-36d71d0c66a9" status: 202 len: 0 microversion: 2.1 time: 0.062123 Aug 31 19:35:07.342517 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 622/1242] 10.222.0.65 () {58 vars in 1254 bytes} [Wed Aug 31 19:35:07 2022] DELETE /compute/v2.1/os-snapshots/31f28acf-f12d-4cff-8056-36d71d0c66a9 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:35:07.350538 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-0c1eb282-3215-48e3-bbf5-382cd1c0deef tempest-VolumesSnapshotsTestJSON-652545629 tempest-VolumesSnapshotsTestJSON-652545629-project] Calling method '.version_select at 0x7fdb86634ca0>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:07.380974 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-0c1eb282-3215-48e3-bbf5-382cd1c0deef tempest-VolumesSnapshotsTestJSON-652545629 tempest-VolumesSnapshotsTestJSON-652545629-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/31f28acf-f12d-4cff-8056-36d71d0c66a9" status: 200 len: 286 microversion: 2.1 time: 0.034167 Aug 31 19:35:07.381572 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 621/1243] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Aug 31 19:35:07 2022] GET /compute/v2.1/os-snapshots/31f28acf-f12d-4cff-8056-36d71d0c66a9 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:35:08.394215 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-4f7efacc-0a66-4dcf-bec5-09c5ebc45f6a tempest-VolumesSnapshotsTestJSON-652545629 tempest-VolumesSnapshotsTestJSON-652545629-project] Calling method '.version_select at 0x7fdb8619d8b0>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:08.418817 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.wsgi [None req-4f7efacc-0a66-4dcf-bec5-09c5ebc45f6a tempest-VolumesSnapshotsTestJSON-652545629 tempest-VolumesSnapshotsTestJSON-652545629-project] HTTP exception thrown: Snapshot 31f28acf-f12d-4cff-8056-36d71d0c66a9 could not be found. Aug 31 19:35:08.421019 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-4f7efacc-0a66-4dcf-bec5-09c5ebc45f6a tempest-VolumesSnapshotsTestJSON-652545629 tempest-VolumesSnapshotsTestJSON-652545629-project] Request method failure captured: Aug 31 19:35:08.421019 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: request: GET /compute/v2.1/os-snapshots/31f28acf-f12d-4cff-8056-36d71d0c66a9 HTTP/1.1 Aug 31 19:35:08.421019 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Accept: application/json Aug 31 19:35:08.421019 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Accept-Encoding: identity Aug 31 19:35:08.421019 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Connection: close Aug 31 19:35:08.421019 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Content-Length: 0 Aug 31 19:35:08.421019 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Content-Type: application/json Aug 31 19:35:08.421019 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Host: 10.222.0.65 Aug 31 19:35:08.421019 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Openstack-System-Scope: None Aug 31 19:35:08.421019 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: User-Agent: python-urllib3/1.26.12 Aug 31 19:35:08.421019 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Auth-Token: gAAAAABjD7flQYDXi8T4XPEBTfASoHYrWolU1fQgg5LWrNB9JlgeloQJZUDaeCYNtkeGUgCBQqBzB230l3s4yVCFXNDARtCq_i_85Z_0DXj7dJi42k51AhzZqfIBtBStutErqEC1PLnBiDT8zhYfZKqBZ8g2KgwE4jNOtdf100RTBNE7qjuFI14 Aug 31 19:35:08.421019 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Domain-Id: None Aug 31 19:35:08.421019 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Domain-Name: None Aug 31 19:35:08.421019 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Identity-Status: Confirmed Aug 31 19:35:08.421019 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Is-Admin-Project: True Aug 31 19:35:08.421019 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Id: default Aug 31 19:35:08.421019 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Name: Default Aug 31 19:35:08.421019 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Id: 0a7314d447be4a3cb0bbcb6b82be76a3 Aug 31 19:35:08.421019 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-652545629 Aug 31 19:35:08.421019 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Role: member,reader Aug 31 19:35:08.421019 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Roles: member,reader Aug 31 19:35:08.422864 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0a7314d447be4a3cb0bbcb6b82be76a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0a7314d447be4a3cb0bbcb6b82be76a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0a7314d447be4a3cb0bbcb6b82be76a3", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0a7314d447be4a3cb0bbcb6b82be76a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:35:08.422864 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant: tempest-VolumesSnapshotsTestJSON-652545629 Aug 31 19:35:08.422864 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant-Id: 0a7314d447be4a3cb0bbcb6b82be76a3 Aug 31 19:35:08.422864 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-652545629 Aug 31 19:35:08.422864 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User: tempest-VolumesSnapshotsTestJSON-652545629-project Aug 31 19:35:08.422864 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Id: default Aug 31 19:35:08.422864 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Name: Default Aug 31 19:35:08.422864 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Id: 464229f012424659878cf01ee92145e0 Aug 31 19:35:08.422864 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Name: tempest-VolumesSnapshotsTestJSON-652545629-project Aug 31 19:35:08.422864 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: method: Aug 31 19:35:08.422864 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: exception: Snapshot 31f28acf-f12d-4cff-8056-36d71d0c66a9 could not be found. Aug 31 19:35:08.422864 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: action_args: {'id': '31f28acf-f12d-4cff-8056-36d71d0c66a9'} Aug 31 19:35:08.422864 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:35:08.424078 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:35:08.424078 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 31 19:35:08.424078 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 31 19:35:08.424078 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 31 19:35:08.424078 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 31 19:35:08.424078 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 31 19:35:08.424078 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 31 19:35:08.424078 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 19:35:08.424078 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 19:35:08.424078 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 19:35:08.424078 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 19:35:08.424078 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 19:35:08.424078 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 19:35:08.424078 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 19:35:08.424078 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 19:35:08.424078 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 31f28acf-f12d-4cff-8056-36d71d0c66a9 could not be found. (HTTP 404) (Request-ID: req-3906a7eb-984b-4314-8647-780afb37857b) Aug 31 19:35:08.424078 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:35:08.424078 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:35:08.425567 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:35:08.425567 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:35:08.425567 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 31 19:35:08.425567 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 31 19:35:08.425567 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 19:35:08.425567 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 19:35:08.425567 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 31 19:35:08.425567 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 31 19:35:08.425567 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 19:35:08.425567 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 19:35:08.425567 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 31 19:35:08.425567 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 31 19:35:08.425567 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 31 19:35:08.425567 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 31 19:35:08.425567 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 31 19:35:08.425567 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 31 19:35:08.425567 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 19:35:08.425567 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 19:35:08.425567 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 19:35:08.427192 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 19:35:08.427192 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 19:35:08.427192 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 19:35:08.427192 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 19:35:08.427192 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 19:35:08.427192 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 31f28acf-f12d-4cff-8056-36d71d0c66a9 could not be found. Aug 31 19:35:08.427192 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:35:08.427192 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:35:08.427192 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:35:08.427192 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:35:08.427192 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:35:08.427192 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:35:08.427192 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:35:08.427192 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:35:08.427192 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 19:35:08.427192 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 19:35:08.427192 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:35:08.427192 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:35:08.427192 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 31 19:35:08.427192 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:35:08.428769 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 31f28acf-f12d-4cff-8056-36d71d0c66a9 could not be found. Aug 31 19:35:08.428769 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:35:08.428769 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:35:08.428769 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:35:08.428769 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:35:08.428769 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:35:08.428769 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:35:08.428769 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:35:08.428769 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:35:08.428769 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 31f28acf-f12d-4cff-8056-36d71d0c66a9 could not be found. Aug 31 19:35:08.428769 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:35:08.428769 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-4f7efacc-0a66-4dcf-bec5-09c5ebc45f6a tempest-VolumesSnapshotsTestJSON-652545629 tempest-VolumesSnapshotsTestJSON-652545629-project] Returning 404 to user: Snapshot 31f28acf-f12d-4cff-8056-36d71d0c66a9 could not be found. {{(pid=120623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:35:08.428769 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-4f7efacc-0a66-4dcf-bec5-09c5ebc45f6a tempest-VolumesSnapshotsTestJSON-652545629 tempest-VolumesSnapshotsTestJSON-652545629-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/31f28acf-f12d-4cff-8056-36d71d0c66a9" status: 404 len: 111 microversion: 2.1 time: 0.032673 Aug 31 19:35:08.429837 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 623/1244] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Aug 31 19:35:08 2022] GET /compute/v2.1/os-snapshots/31f28acf-f12d-4cff-8056-36d71d0c66a9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:35:08.431794 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-374b9223-7ad6-4f10-9a22-c2365b3aae0c tempest-VolumesSnapshotsTestJSON-652545629 tempest-VolumesSnapshotsTestJSON-652545629-project] Calling method '.version_select at 0x7fdb89af5820>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:08.493949 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-374b9223-7ad6-4f10-9a22-c2365b3aae0c tempest-VolumesSnapshotsTestJSON-652545629 tempest-VolumesSnapshotsTestJSON-652545629-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/5c26e2be-4700-4b00-b327-3befb449903b" status: 202 len: 0 microversion: 2.1 time: 0.066591 Aug 31 19:35:08.494520 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 622/1245] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Aug 31 19:35:08 2022] DELETE /compute/v2.1/os-volumes/5c26e2be-4700-4b00-b327-3befb449903b => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 19:35:08.502935 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-4f00becf-fc92-4004-b2f4-09f4effdb98f tempest-VolumesSnapshotsTestJSON-652545629 tempest-VolumesSnapshotsTestJSON-652545629-project] Calling method '.version_select at 0x7fdb861934c0>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:08.550949 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-4f00becf-fc92-4004-b2f4-09f4effdb98f tempest-VolumesSnapshotsTestJSON-652545629 tempest-VolumesSnapshotsTestJSON-652545629-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/5c26e2be-4700-4b00-b327-3befb449903b" status: 200 len: 344 microversion: 2.1 time: 0.052037 Aug 31 19:35:08.551537 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 624/1246] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 31 19:35:08 2022] GET /compute/v2.1/os-volumes/5c26e2be-4700-4b00-b327-3befb449903b => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:35:09.565385 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-b98c0519-43a1-4414-8914-fa9d11dc2884 tempest-VolumesSnapshotsTestJSON-652545629 tempest-VolumesSnapshotsTestJSON-652545629-project] Calling method '.version_select at 0x7fdb86634af0>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:09.593239 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.wsgi [None req-b98c0519-43a1-4414-8914-fa9d11dc2884 tempest-VolumesSnapshotsTestJSON-652545629 tempest-VolumesSnapshotsTestJSON-652545629-project] HTTP exception thrown: Volume 5c26e2be-4700-4b00-b327-3befb449903b could not be found. Aug 31 19:35:09.595154 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-b98c0519-43a1-4414-8914-fa9d11dc2884 tempest-VolumesSnapshotsTestJSON-652545629 tempest-VolumesSnapshotsTestJSON-652545629-project] Request method failure captured: Aug 31 19:35:09.595154 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: request: GET /compute/v2.1/os-volumes/5c26e2be-4700-4b00-b327-3befb449903b HTTP/1.1 Aug 31 19:35:09.595154 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept: application/json Aug 31 19:35:09.595154 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Aug 31 19:35:09.595154 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Connection: close Aug 31 19:35:09.595154 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Length: 0 Aug 31 19:35:09.595154 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Type: application/json Aug 31 19:35:09.595154 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Host: 10.222.0.65 Aug 31 19:35:09.595154 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Aug 31 19:35:09.595154 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Aug 31 19:35:09.595154 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjD7flQYDXi8T4XPEBTfASoHYrWolU1fQgg5LWrNB9JlgeloQJZUDaeCYNtkeGUgCBQqBzB230l3s4yVCFXNDARtCq_i_85Z_0DXj7dJi42k51AhzZqfIBtBStutErqEC1PLnBiDT8zhYfZKqBZ8g2KgwE4jNOtdf100RTBNE7qjuFI14 Aug 31 19:35:09.595154 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Aug 31 19:35:09.595154 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Aug 31 19:35:09.595154 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Aug 31 19:35:09.595154 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Aug 31 19:35:09.595154 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Aug 31 19:35:09.595154 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Aug 31 19:35:09.595154 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Id: 0a7314d447be4a3cb0bbcb6b82be76a3 Aug 31 19:35:09.595154 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-652545629 Aug 31 19:35:09.595154 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Role: member,reader Aug 31 19:35:09.595154 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Roles: member,reader Aug 31 19:35:09.596892 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0a7314d447be4a3cb0bbcb6b82be76a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0a7314d447be4a3cb0bbcb6b82be76a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0a7314d447be4a3cb0bbcb6b82be76a3", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0a7314d447be4a3cb0bbcb6b82be76a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:35:09.596892 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-VolumesSnapshotsTestJSON-652545629 Aug 31 19:35:09.596892 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Id: 0a7314d447be4a3cb0bbcb6b82be76a3 Aug 31 19:35:09.596892 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-652545629 Aug 31 19:35:09.596892 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User: tempest-VolumesSnapshotsTestJSON-652545629-project Aug 31 19:35:09.596892 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Aug 31 19:35:09.596892 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Aug 31 19:35:09.596892 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Id: 464229f012424659878cf01ee92145e0 Aug 31 19:35:09.596892 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-VolumesSnapshotsTestJSON-652545629-project Aug 31 19:35:09.596892 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: method: Aug 31 19:35:09.596892 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: exception: Volume 5c26e2be-4700-4b00-b327-3befb449903b could not be found. Aug 31 19:35:09.596892 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: action_args: {'id': '5c26e2be-4700-4b00-b327-3befb449903b'} Aug 31 19:35:09.596892 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:35:09.597989 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:35:09.597989 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 19:35:09.597989 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 19:35:09.597989 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 19:35:09.597989 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 19:35:09.597989 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 19:35:09.597989 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 19:35:09.597989 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 19:35:09.597989 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 19:35:09.597989 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 19:35:09.597989 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 19:35:09.597989 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 19:35:09.597989 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 19:35:09.597989 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 19:35:09.597989 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 19:35:09.597989 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5c26e2be-4700-4b00-b327-3befb449903b could not be found. (HTTP 404) (Request-ID: req-80c4fe90-acdc-4341-a7a4-32639f09a765) Aug 31 19:35:09.597989 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:35:09.597989 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:35:09.597989 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:35:09.599518 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:35:09.599518 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 19:35:09.599518 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 19:35:09.599518 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 19:35:09.599518 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 19:35:09.599518 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 19:35:09.599518 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 19:35:09.599518 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 19:35:09.599518 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 19:35:09.599518 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 19:35:09.599518 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 19:35:09.599518 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 19:35:09.599518 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 19:35:09.599518 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 19:35:09.599518 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 19:35:09.599518 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 19:35:09.599518 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 19:35:09.599518 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 19:35:09.599518 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 19:35:09.601856 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 19:35:09.601856 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 19:35:09.601856 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 19:35:09.601856 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 19:35:09.601856 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5c26e2be-4700-4b00-b327-3befb449903b could not be found. Aug 31 19:35:09.601856 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:35:09.601856 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:35:09.601856 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:35:09.601856 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:35:09.601856 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:35:09.601856 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:35:09.601856 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:35:09.601856 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:35:09.601856 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 19:35:09.601856 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 19:35:09.601856 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:35:09.601856 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:35:09.601856 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 19:35:09.601856 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:35:09.603445 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5c26e2be-4700-4b00-b327-3befb449903b could not be found. Aug 31 19:35:09.603445 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:35:09.603445 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:35:09.603445 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:35:09.603445 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:35:09.603445 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:35:09.603445 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:35:09.603445 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:35:09.603445 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:35:09.603445 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5c26e2be-4700-4b00-b327-3befb449903b could not be found. Aug 31 19:35:09.603445 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:35:09.603445 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-b98c0519-43a1-4414-8914-fa9d11dc2884 tempest-VolumesSnapshotsTestJSON-652545629 tempest-VolumesSnapshotsTestJSON-652545629-project] Returning 404 to user: Volume 5c26e2be-4700-4b00-b327-3befb449903b could not be found. {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:35:09.603445 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-b98c0519-43a1-4414-8914-fa9d11dc2884 tempest-VolumesSnapshotsTestJSON-652545629 tempest-VolumesSnapshotsTestJSON-652545629-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/5c26e2be-4700-4b00-b327-3befb449903b" status: 404 len: 109 microversion: 2.1 time: 0.035488 Aug 31 19:35:09.603445 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 623/1247] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 31 19:35:09 2022] GET /compute/v2.1/os-volumes/5c26e2be-4700-4b00-b327-3befb449903b => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:35:09.611496 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-34c5c61d-0fec-4ef0-a0c2-f08d8d07ebdd tempest-VolumesSnapshotsTestJSON-652545629 tempest-VolumesSnapshotsTestJSON-652545629-project] Calling method '.version_select at 0x7fdb8619d790>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:09.639119 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.wsgi [None req-34c5c61d-0fec-4ef0-a0c2-f08d8d07ebdd tempest-VolumesSnapshotsTestJSON-652545629 tempest-VolumesSnapshotsTestJSON-652545629-project] HTTP exception thrown: Volume 5c26e2be-4700-4b00-b327-3befb449903b could not be found. Aug 31 19:35:09.641102 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-34c5c61d-0fec-4ef0-a0c2-f08d8d07ebdd tempest-VolumesSnapshotsTestJSON-652545629 tempest-VolumesSnapshotsTestJSON-652545629-project] Request method failure captured: Aug 31 19:35:09.641102 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: request: DELETE /compute/v2.1/os-volumes/5c26e2be-4700-4b00-b327-3befb449903b HTTP/1.1 Aug 31 19:35:09.641102 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Accept: application/json Aug 31 19:35:09.641102 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Accept-Encoding: identity Aug 31 19:35:09.641102 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Connection: close Aug 31 19:35:09.641102 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Content-Length: 0 Aug 31 19:35:09.641102 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Content-Type: application/json Aug 31 19:35:09.641102 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Host: 10.222.0.65 Aug 31 19:35:09.641102 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Openstack-System-Scope: None Aug 31 19:35:09.641102 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: User-Agent: python-urllib3/1.26.12 Aug 31 19:35:09.641102 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Auth-Token: gAAAAABjD7flQYDXi8T4XPEBTfASoHYrWolU1fQgg5LWrNB9JlgeloQJZUDaeCYNtkeGUgCBQqBzB230l3s4yVCFXNDARtCq_i_85Z_0DXj7dJi42k51AhzZqfIBtBStutErqEC1PLnBiDT8zhYfZKqBZ8g2KgwE4jNOtdf100RTBNE7qjuFI14 Aug 31 19:35:09.641102 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Domain-Id: None Aug 31 19:35:09.641102 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Domain-Name: None Aug 31 19:35:09.641102 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Identity-Status: Confirmed Aug 31 19:35:09.641102 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Is-Admin-Project: True Aug 31 19:35:09.641102 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Id: default Aug 31 19:35:09.641102 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Name: Default Aug 31 19:35:09.641102 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Id: 0a7314d447be4a3cb0bbcb6b82be76a3 Aug 31 19:35:09.641102 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-652545629 Aug 31 19:35:09.641102 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Role: member,reader Aug 31 19:35:09.641102 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Roles: member,reader Aug 31 19:35:09.642879 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0a7314d447be4a3cb0bbcb6b82be76a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0a7314d447be4a3cb0bbcb6b82be76a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0a7314d447be4a3cb0bbcb6b82be76a3", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0a7314d447be4a3cb0bbcb6b82be76a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:35:09.642879 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant: tempest-VolumesSnapshotsTestJSON-652545629 Aug 31 19:35:09.642879 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant-Id: 0a7314d447be4a3cb0bbcb6b82be76a3 Aug 31 19:35:09.642879 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-652545629 Aug 31 19:35:09.642879 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User: tempest-VolumesSnapshotsTestJSON-652545629-project Aug 31 19:35:09.642879 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Id: default Aug 31 19:35:09.642879 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Name: Default Aug 31 19:35:09.642879 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Id: 464229f012424659878cf01ee92145e0 Aug 31 19:35:09.642879 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Name: tempest-VolumesSnapshotsTestJSON-652545629-project Aug 31 19:35:09.642879 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: method: Aug 31 19:35:09.642879 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: exception: Volume 5c26e2be-4700-4b00-b327-3befb449903b could not be found. Aug 31 19:35:09.642879 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: action_args: {'id': '5c26e2be-4700-4b00-b327-3befb449903b'} Aug 31 19:35:09.642879 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:35:09.643937 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:35:09.643937 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 19:35:09.643937 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 19:35:09.643937 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 19:35:09.643937 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 19:35:09.643937 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 19:35:09.643937 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 19:35:09.643937 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 19:35:09.643937 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 19:35:09.643937 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 19:35:09.643937 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 19:35:09.643937 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 19:35:09.643937 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 19:35:09.643937 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 19:35:09.643937 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 19:35:09.643937 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5c26e2be-4700-4b00-b327-3befb449903b could not be found. (HTTP 404) (Request-ID: req-6153d840-4f80-4377-8b6a-d7d610eaf183) Aug 31 19:35:09.643937 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:35:09.643937 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:35:09.643937 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:35:09.645587 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:35:09.645587 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 19:35:09.645587 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 19:35:09.645587 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 19:35:09.645587 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 19:35:09.645587 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 19:35:09.645587 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 19:35:09.645587 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 19:35:09.645587 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 19:35:09.645587 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 19:35:09.645587 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 19:35:09.645587 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 19:35:09.645587 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 19:35:09.645587 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 19:35:09.645587 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 19:35:09.645587 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 19:35:09.645587 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 19:35:09.645587 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 19:35:09.645587 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 19:35:09.647374 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 19:35:09.647374 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 19:35:09.647374 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 19:35:09.647374 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 19:35:09.647374 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5c26e2be-4700-4b00-b327-3befb449903b could not be found. Aug 31 19:35:09.647374 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:35:09.647374 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:35:09.647374 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:35:09.647374 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:35:09.647374 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:35:09.647374 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:35:09.647374 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:35:09.647374 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:35:09.647374 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 19:35:09.647374 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 19:35:09.647374 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:35:09.647374 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:35:09.647374 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 19:35:09.647374 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:35:09.648862 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5c26e2be-4700-4b00-b327-3befb449903b could not be found. Aug 31 19:35:09.648862 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:35:09.648862 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:35:09.648862 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:35:09.648862 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:35:09.648862 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:35:09.648862 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:35:09.648862 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:35:09.648862 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:35:09.648862 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5c26e2be-4700-4b00-b327-3befb449903b could not be found. Aug 31 19:35:09.648862 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:35:09.648862 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-34c5c61d-0fec-4ef0-a0c2-f08d8d07ebdd tempest-VolumesSnapshotsTestJSON-652545629 tempest-VolumesSnapshotsTestJSON-652545629-project] Returning 404 to user: Volume 5c26e2be-4700-4b00-b327-3befb449903b could not be found. {{(pid=120623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:35:09.648862 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-34c5c61d-0fec-4ef0-a0c2-f08d8d07ebdd tempest-VolumesSnapshotsTestJSON-652545629 tempest-VolumesSnapshotsTestJSON-652545629-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/5c26e2be-4700-4b00-b327-3befb449903b" status: 404 len: 109 microversion: 2.1 time: 0.035274 Aug 31 19:35:09.648862 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 625/1248] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Aug 31 19:35:09 2022] DELETE /compute/v2.1/os-volumes/5c26e2be-4700-4b00-b327-3befb449903b => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:35:09.651219 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-65769684-269b-4c49-a9d7-1bdee16c4dfc tempest-VolumesSnapshotsTestJSON-652545629 tempest-VolumesSnapshotsTestJSON-652545629-project] Calling method '.version_select at 0x7fdb89af5c10>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:09.679733 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.wsgi [None req-65769684-269b-4c49-a9d7-1bdee16c4dfc tempest-VolumesSnapshotsTestJSON-652545629 tempest-VolumesSnapshotsTestJSON-652545629-project] HTTP exception thrown: Volume 5c26e2be-4700-4b00-b327-3befb449903b could not be found. Aug 31 19:35:09.681699 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-65769684-269b-4c49-a9d7-1bdee16c4dfc tempest-VolumesSnapshotsTestJSON-652545629 tempest-VolumesSnapshotsTestJSON-652545629-project] Request method failure captured: Aug 31 19:35:09.681699 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: request: GET /compute/v2.1/os-volumes/5c26e2be-4700-4b00-b327-3befb449903b HTTP/1.1 Aug 31 19:35:09.681699 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept: application/json Aug 31 19:35:09.681699 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Aug 31 19:35:09.681699 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Connection: close Aug 31 19:35:09.681699 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Length: 0 Aug 31 19:35:09.681699 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Type: application/json Aug 31 19:35:09.681699 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Host: 10.222.0.65 Aug 31 19:35:09.681699 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Aug 31 19:35:09.681699 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Aug 31 19:35:09.681699 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjD7flQYDXi8T4XPEBTfASoHYrWolU1fQgg5LWrNB9JlgeloQJZUDaeCYNtkeGUgCBQqBzB230l3s4yVCFXNDARtCq_i_85Z_0DXj7dJi42k51AhzZqfIBtBStutErqEC1PLnBiDT8zhYfZKqBZ8g2KgwE4jNOtdf100RTBNE7qjuFI14 Aug 31 19:35:09.681699 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Aug 31 19:35:09.681699 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Aug 31 19:35:09.681699 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Aug 31 19:35:09.681699 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Aug 31 19:35:09.681699 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Aug 31 19:35:09.681699 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Aug 31 19:35:09.681699 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Id: 0a7314d447be4a3cb0bbcb6b82be76a3 Aug 31 19:35:09.681699 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-652545629 Aug 31 19:35:09.681699 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Role: member,reader Aug 31 19:35:09.681699 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Roles: member,reader Aug 31 19:35:09.683393 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0a7314d447be4a3cb0bbcb6b82be76a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0a7314d447be4a3cb0bbcb6b82be76a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0a7314d447be4a3cb0bbcb6b82be76a3", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0a7314d447be4a3cb0bbcb6b82be76a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:35:09.683393 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-VolumesSnapshotsTestJSON-652545629 Aug 31 19:35:09.683393 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Id: 0a7314d447be4a3cb0bbcb6b82be76a3 Aug 31 19:35:09.683393 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-652545629 Aug 31 19:35:09.683393 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User: tempest-VolumesSnapshotsTestJSON-652545629-project Aug 31 19:35:09.683393 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Aug 31 19:35:09.683393 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Aug 31 19:35:09.683393 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Id: 464229f012424659878cf01ee92145e0 Aug 31 19:35:09.683393 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-VolumesSnapshotsTestJSON-652545629-project Aug 31 19:35:09.683393 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: method: Aug 31 19:35:09.683393 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: exception: Volume 5c26e2be-4700-4b00-b327-3befb449903b could not be found. Aug 31 19:35:09.683393 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: action_args: {'id': '5c26e2be-4700-4b00-b327-3befb449903b'} Aug 31 19:35:09.683393 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:35:09.684431 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:35:09.684431 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 19:35:09.684431 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 19:35:09.684431 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 19:35:09.684431 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 19:35:09.684431 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 19:35:09.684431 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 19:35:09.684431 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 19:35:09.684431 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 19:35:09.684431 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 19:35:09.684431 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 19:35:09.684431 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 19:35:09.684431 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 19:35:09.684431 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 19:35:09.684431 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 19:35:09.684431 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5c26e2be-4700-4b00-b327-3befb449903b could not be found. (HTTP 404) (Request-ID: req-911ed8ec-0db7-492f-b857-a8b9d3b531a9) Aug 31 19:35:09.684431 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:35:09.684431 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:35:09.684431 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:35:09.685786 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:35:09.685786 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 19:35:09.685786 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 19:35:09.685786 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 19:35:09.685786 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 19:35:09.685786 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 19:35:09.685786 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 19:35:09.685786 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 19:35:09.685786 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 19:35:09.685786 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 19:35:09.685786 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 19:35:09.685786 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 19:35:09.685786 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 19:35:09.685786 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 19:35:09.685786 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 19:35:09.685786 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 19:35:09.685786 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 19:35:09.685786 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 19:35:09.685786 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 19:35:09.687048 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 19:35:09.687048 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 19:35:09.687048 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 19:35:09.687048 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 19:35:09.687048 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5c26e2be-4700-4b00-b327-3befb449903b could not be found. Aug 31 19:35:09.687048 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:35:09.687048 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:35:09.687048 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:35:09.687048 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:35:09.687048 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:35:09.687048 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:35:09.687048 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:35:09.687048 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:35:09.687048 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 19:35:09.687048 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 19:35:09.687048 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:35:09.687048 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:35:09.687048 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 19:35:09.687048 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:35:09.688321 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5c26e2be-4700-4b00-b327-3befb449903b could not be found. Aug 31 19:35:09.688321 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:35:09.688321 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:35:09.688321 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:35:09.688321 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:35:09.688321 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:35:09.688321 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:35:09.688321 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:35:09.688321 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:35:09.688321 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5c26e2be-4700-4b00-b327-3befb449903b could not be found. Aug 31 19:35:09.688321 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:35:09.688321 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-65769684-269b-4c49-a9d7-1bdee16c4dfc tempest-VolumesSnapshotsTestJSON-652545629 tempest-VolumesSnapshotsTestJSON-652545629-project] Returning 404 to user: Volume 5c26e2be-4700-4b00-b327-3befb449903b could not be found. {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:35:09.688321 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-65769684-269b-4c49-a9d7-1bdee16c4dfc tempest-VolumesSnapshotsTestJSON-652545629 tempest-VolumesSnapshotsTestJSON-652545629-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/5c26e2be-4700-4b00-b327-3befb449903b" status: 404 len: 109 microversion: 2.1 time: 0.035640 Aug 31 19:35:09.688321 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 624/1249] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 31 19:35:09 2022] GET /compute/v2.1/os-volumes/5c26e2be-4700-4b00-b327-3befb449903b => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:36:21.383635 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=1 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:36:21.385056 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 19:36:21.385237 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Wed Aug 31 19:36:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.65) !!! Aug 31 19:36:21.578040 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e6fdc1b0-84e2-4d61-83cf-1c670ce31aed tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Action: 'create', calling method: .version_select at 0x7fdb8668e280>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-735888209", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOHTJS9vEbWVJA8Wg+Fwg2K0yqJRAQ90EfneK8gt5bca+YZOUTJ3MZUm4wicA+my3Axepu7w2v17nHuchgdll8wZrEMn3HxWUIhihT6dllil1edf4s0NvFwrGT0lb3SWg=="}} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:36:21.594225 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.quota [None req-e6fdc1b0-84e2-4d61-83cf-1c670ce31aed tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Getting quotas for project 2f7614eeafc645958e7308586df90b8e. Resources: {'key_pairs'} {{(pid=120623) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:36:21.599398 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.quota [None req-e6fdc1b0-84e2-4d61-83cf-1c670ce31aed tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Getting quotas for user 8983f4ff039e4f6bbf01159accb1fb7c and project 2f7614eeafc645958e7308586df90b8e. Resources: {'key_pairs'} {{(pid=120623) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:36:21.624642 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-e6fdc1b0-84e2-4d61-83cf-1c670ce31aed tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.242357 Aug 31 19:36:21.625439 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 626/1250] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Aug 31 19:36:21 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:36:45.272308 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0f7c495b-5fab-475e-b999-c97a21a2120f] AMQP server on 10.222.0.65:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 31 19:36:45.273352 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 19:36:45.273494 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Wed Aug 31 19:36:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.65) !!! Aug 31 19:36:45.274930 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 19:36:45.275059 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Wed Aug 31 19:36:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.65) !!! Aug 31 19:36:45.282185 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-57691206-dfc6-42fa-8695-859e7a3e026f tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1457422962", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-735888209", "security_groups": [{"name": "tempest-secgroup-smoke-1884254819"}], "block_device_mapping_v2": [{"uuid": "d624cb6e-b3cd-44d5-b5f2-4083737f05b2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "12c490a0-1e02-4358-9614-c12af23b9c0c"}]}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:36:45.403808 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.network.neutron [None req-57691206-dfc6-42fa-8695-859e7a3e026f tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] validate_networks() for [('12c490a0-1e02-4358-9614-c12af23b9c0c', None, None, None, None, None)] {{(pid=120624) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:36:46.122950 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-57691206-dfc6-42fa-8695-859e7a3e026f tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Flavor limits 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:36:46.123946 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-57691206-dfc6-42fa-8695-859e7a3e026f tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Image limits 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:36:46.124413 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-57691206-dfc6-42fa-8695-859e7a3e026f tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Flavor pref 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:36:46.124812 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-57691206-dfc6-42fa-8695-859e7a3e026f tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Image pref 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:36:46.125242 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-57691206-dfc6-42fa-8695-859e7a3e026f tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:36:46.134029 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-57691206-dfc6-42fa-8695-859e7a3e026f tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:46.134505 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-57691206-dfc6-42fa-8695-859e7a3e026f tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:46.134934 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-57691206-dfc6-42fa-8695-859e7a3e026f tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:46.135652 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-57691206-dfc6-42fa-8695-859e7a3e026f tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:46.136096 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-57691206-dfc6-42fa-8695-859e7a3e026f tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:46.136514 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-57691206-dfc6-42fa-8695-859e7a3e026f tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:46.153969 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-57691206-dfc6-42fa-8695-859e7a3e026f tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Getting quotas for project 2f7614eeafc645958e7308586df90b8e. Resources: {'instances', 'cores', 'ram'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:36:46.158036 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-57691206-dfc6-42fa-8695-859e7a3e026f tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Getting quotas for user 8983f4ff039e4f6bbf01159accb1fb7c and project 2f7614eeafc645958e7308586df90b8e. Resources: {'instances', 'cores', 'ram'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:36:46.215634 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-57691206-dfc6-42fa-8695-859e7a3e026f tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Going to run 1 instances... {{(pid=120624) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:36:46.217926 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-57691206-dfc6-42fa-8695-859e7a3e026f tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: e9c550c2-bc03-4e38-a7b7-3035d095deff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d624cb6e-b3cd-44d5-b5f2-4083737f05b2',volume_size=None,volume_type=None)] {{(pid=120624) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:36:46.282089 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO oslo.messaging._drivers.impl_rabbit [-] [0f7c495b-5fab-475e-b999-c97a21a2120f] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 43430. Aug 31 19:36:46.352898 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-57691206-dfc6-42fa-8695-859e7a3e026f tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.083223 Aug 31 19:36:46.353635 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 625/1251] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 31 19:36:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 1085 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 19:36:46.365907 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-b4b60000-bf1f-4134-8d36-492e82bc99f5 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:36:46.366636 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-b4b60000-bf1f-4134-8d36-492e82bc99f5 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: e9c550c2-bc03-4e38-a7b7-3035d095deff] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:36:46.368780 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell0:SELECT=4 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:36:46.369480 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:36:46.428605 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-b4b60000-bf1f-4134-8d36-492e82bc99f5 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8983f4ff039e4f6bbf01159accb1fb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7614eeafc645958e7308586df90b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:36:46.435565 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-b4b60000-bf1f-4134-8d36-492e82bc99f5 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/e9c550c2-bc03-4e38-a7b7-3035d095deff" status: 200 len: 1094 microversion: 2.1 time: 0.073820 Aug 31 19:36:46.437546 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 627/1252] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:36:46 2022] GET /compute/v2.1/servers/e9c550c2-bc03-4e38-a7b7-3035d095deff => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:36:47.457209 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-48cf3df6-e382-49e8-b882-5a6a741817b3 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:36:47.457755 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-48cf3df6-e382-49e8-b882-5a6a741817b3 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: e9c550c2-bc03-4e38-a7b7-3035d095deff] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:36:47.466100 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-48cf3df6-e382-49e8-b882-5a6a741817b3 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:47.466589 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-48cf3df6-e382-49e8-b882-5a6a741817b3 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:47.467859 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-48cf3df6-e382-49e8-b882-5a6a741817b3 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:47.468783 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-48cf3df6-e382-49e8-b882-5a6a741817b3 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:47.469272 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-48cf3df6-e382-49e8-b882-5a6a741817b3 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:47.469719 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-48cf3df6-e382-49e8-b882-5a6a741817b3 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:47.530048 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-48cf3df6-e382-49e8-b882-5a6a741817b3 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8983f4ff039e4f6bbf01159accb1fb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7614eeafc645958e7308586df90b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:36:47.537584 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-48cf3df6-e382-49e8-b882-5a6a741817b3 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/e9c550c2-bc03-4e38-a7b7-3035d095deff" status: 200 len: 1192 microversion: 2.1 time: 0.085062 Aug 31 19:36:47.538157 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 626/1253] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:36:47 2022] GET /compute/v2.1/servers/e9c550c2-bc03-4e38-a7b7-3035d095deff => generated 1192 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:36:48.557914 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-180e0165-05da-48ff-b8d4-3df9f03f42f7 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:36:48.558681 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-180e0165-05da-48ff-b8d4-3df9f03f42f7 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: e9c550c2-bc03-4e38-a7b7-3035d095deff] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:36:48.565951 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-180e0165-05da-48ff-b8d4-3df9f03f42f7 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:48.566439 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-180e0165-05da-48ff-b8d4-3df9f03f42f7 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:48.566872 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-180e0165-05da-48ff-b8d4-3df9f03f42f7 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:48.567608 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-180e0165-05da-48ff-b8d4-3df9f03f42f7 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:48.568061 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-180e0165-05da-48ff-b8d4-3df9f03f42f7 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:48.568487 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-180e0165-05da-48ff-b8d4-3df9f03f42f7 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:48.719336 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-180e0165-05da-48ff-b8d4-3df9f03f42f7 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8983f4ff039e4f6bbf01159accb1fb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7614eeafc645958e7308586df90b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:36:48.727938 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-180e0165-05da-48ff-b8d4-3df9f03f42f7 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/e9c550c2-bc03-4e38-a7b7-3035d095deff" status: 200 len: 1278 microversion: 2.1 time: 0.173735 Aug 31 19:36:48.729072 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 628/1254] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:36:48 2022] GET /compute/v2.1/servers/e9c550c2-bc03-4e38-a7b7-3035d095deff => generated 1278 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:36:49.341848 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-28438475-f565-4cf1-902c-f8d937e4c4d0 req-15ce13c6-3ea0-4e99-acb3-18304e1021a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9c550c2-bc03-4e38-a7b7-3035d095deff", "tag": "c2d492fd-bbe4-4a69-a026-48e4a87afc79"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:36:49.352380 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-28438475-f565-4cf1-902c-f8d937e4c4d0 req-15ce13c6-3ea0-4e99-acb3-18304e1021a8 service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:49.352940 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-28438475-f565-4cf1-902c-f8d937e4c4d0 req-15ce13c6-3ea0-4e99-acb3-18304e1021a8 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:49.354115 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-28438475-f565-4cf1-902c-f8d937e4c4d0 req-15ce13c6-3ea0-4e99-acb3-18304e1021a8 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:49.366482 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-28438475-f565-4cf1-902c-f8d937e4c4d0 req-15ce13c6-3ea0-4e99-acb3-18304e1021a8 service nova] Creating event network-changed:c2d492fd-bbe4-4a69-a026-48e4a87afc79 for instance e9c550c2-bc03-4e38-a7b7-3035d095deff on hv-cinder-83538 Aug 31 19:36:49.371591 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-28438475-f565-4cf1-902c-f8d937e4c4d0 req-15ce13c6-3ea0-4e99-acb3-18304e1021a8 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034936 Aug 31 19:36:49.372400 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 627/1255] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:36:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:36:49.748467 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-31b1dced-9c39-4260-8128-ba61afa81d5d tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:36:49.749229 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-31b1dced-9c39-4260-8128-ba61afa81d5d tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: e9c550c2-bc03-4e38-a7b7-3035d095deff] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:36:49.755535 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-31b1dced-9c39-4260-8128-ba61afa81d5d tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:49.756017 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-31b1dced-9c39-4260-8128-ba61afa81d5d tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:49.756457 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-31b1dced-9c39-4260-8128-ba61afa81d5d tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:49.757165 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-31b1dced-9c39-4260-8128-ba61afa81d5d tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:49.757639 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-31b1dced-9c39-4260-8128-ba61afa81d5d tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:49.758064 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-31b1dced-9c39-4260-8128-ba61afa81d5d tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:49.887457 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-31b1dced-9c39-4260-8128-ba61afa81d5d tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8983f4ff039e4f6bbf01159accb1fb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7614eeafc645958e7308586df90b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:36:49.895594 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-31b1dced-9c39-4260-8128-ba61afa81d5d tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/e9c550c2-bc03-4e38-a7b7-3035d095deff" status: 200 len: 1266 microversion: 2.1 time: 0.151566 Aug 31 19:36:49.896138 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 629/1256] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:36:49 2022] GET /compute/v2.1/servers/e9c550c2-bc03-4e38-a7b7-3035d095deff => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:36:50.916471 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-7c5d5f46-299d-4570-82e4-853959206f53 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:36:50.917279 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-7c5d5f46-299d-4570-82e4-853959206f53 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: e9c550c2-bc03-4e38-a7b7-3035d095deff] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:36:50.924417 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7c5d5f46-299d-4570-82e4-853959206f53 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:50.924833 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7c5d5f46-299d-4570-82e4-853959206f53 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:50.925286 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7c5d5f46-299d-4570-82e4-853959206f53 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:50.925989 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7c5d5f46-299d-4570-82e4-853959206f53 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:50.926429 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7c5d5f46-299d-4570-82e4-853959206f53 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:50.926839 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7c5d5f46-299d-4570-82e4-853959206f53 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:51.139336 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-7c5d5f46-299d-4570-82e4-853959206f53 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8983f4ff039e4f6bbf01159accb1fb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7614eeafc645958e7308586df90b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:36:51.147031 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-7c5d5f46-299d-4570-82e4-853959206f53 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/e9c550c2-bc03-4e38-a7b7-3035d095deff" status: 200 len: 1266 microversion: 2.1 time: 0.234885 Aug 31 19:36:51.147591 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 628/1257] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:36:50 2022] GET /compute/v2.1/servers/e9c550c2-bc03-4e38-a7b7-3035d095deff => generated 1266 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:36:52.167913 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-60fbbda4-534d-4356-a142-dbc5da0c4cd7 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:36:52.168597 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-60fbbda4-534d-4356-a142-dbc5da0c4cd7 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: e9c550c2-bc03-4e38-a7b7-3035d095deff] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:36:52.174690 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-60fbbda4-534d-4356-a142-dbc5da0c4cd7 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:52.175171 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-60fbbda4-534d-4356-a142-dbc5da0c4cd7 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:52.175605 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-60fbbda4-534d-4356-a142-dbc5da0c4cd7 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:52.176285 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-60fbbda4-534d-4356-a142-dbc5da0c4cd7 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:52.176735 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-60fbbda4-534d-4356-a142-dbc5da0c4cd7 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:52.177154 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-60fbbda4-534d-4356-a142-dbc5da0c4cd7 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:52.308411 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-60fbbda4-534d-4356-a142-dbc5da0c4cd7 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8983f4ff039e4f6bbf01159accb1fb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7614eeafc645958e7308586df90b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:36:52.316055 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-60fbbda4-534d-4356-a142-dbc5da0c4cd7 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/e9c550c2-bc03-4e38-a7b7-3035d095deff" status: 200 len: 1266 microversion: 2.1 time: 0.151958 Aug 31 19:36:52.316626 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 630/1258] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:36:52 2022] GET /compute/v2.1/servers/e9c550c2-bc03-4e38-a7b7-3035d095deff => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:36:53.337402 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-0689171a-7d66-419b-b10d-260964995891 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:36:53.339280 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-0689171a-7d66-419b-b10d-260964995891 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: e9c550c2-bc03-4e38-a7b7-3035d095deff] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:36:53.346240 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0689171a-7d66-419b-b10d-260964995891 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:53.346719 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0689171a-7d66-419b-b10d-260964995891 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:53.347148 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0689171a-7d66-419b-b10d-260964995891 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:53.347836 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0689171a-7d66-419b-b10d-260964995891 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:53.348284 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0689171a-7d66-419b-b10d-260964995891 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:53.348703 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0689171a-7d66-419b-b10d-260964995891 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:53.478930 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-0689171a-7d66-419b-b10d-260964995891 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8983f4ff039e4f6bbf01159accb1fb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7614eeafc645958e7308586df90b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:36:53.487160 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-0689171a-7d66-419b-b10d-260964995891 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/e9c550c2-bc03-4e38-a7b7-3035d095deff" status: 200 len: 1266 microversion: 2.1 time: 0.154119 Aug 31 19:36:53.487720 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 629/1259] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:36:53 2022] GET /compute/v2.1/servers/e9c550c2-bc03-4e38-a7b7-3035d095deff => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:36:54.507796 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-c098b060-fd3f-4091-bc0a-eeda0e0a4561 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:36:54.508404 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-c098b060-fd3f-4091-bc0a-eeda0e0a4561 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: e9c550c2-bc03-4e38-a7b7-3035d095deff] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:36:54.514845 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c098b060-fd3f-4091-bc0a-eeda0e0a4561 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:54.515325 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c098b060-fd3f-4091-bc0a-eeda0e0a4561 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:54.515757 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c098b060-fd3f-4091-bc0a-eeda0e0a4561 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:54.516450 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c098b060-fd3f-4091-bc0a-eeda0e0a4561 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:54.516900 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c098b060-fd3f-4091-bc0a-eeda0e0a4561 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:54.517356 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c098b060-fd3f-4091-bc0a-eeda0e0a4561 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:54.646821 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-c098b060-fd3f-4091-bc0a-eeda0e0a4561 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8983f4ff039e4f6bbf01159accb1fb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7614eeafc645958e7308586df90b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:36:54.654528 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-c098b060-fd3f-4091-bc0a-eeda0e0a4561 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/e9c550c2-bc03-4e38-a7b7-3035d095deff" status: 200 len: 1266 microversion: 2.1 time: 0.150612 Aug 31 19:36:54.655094 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 631/1260] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:36:54 2022] GET /compute/v2.1/servers/e9c550c2-bc03-4e38-a7b7-3035d095deff => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:36:55.675163 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-11af50ec-6c26-4b8e-9def-0480a11a4bd1 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:36:55.675763 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-11af50ec-6c26-4b8e-9def-0480a11a4bd1 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: e9c550c2-bc03-4e38-a7b7-3035d095deff] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:36:55.682149 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-11af50ec-6c26-4b8e-9def-0480a11a4bd1 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:55.682624 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-11af50ec-6c26-4b8e-9def-0480a11a4bd1 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:55.683072 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-11af50ec-6c26-4b8e-9def-0480a11a4bd1 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:55.683734 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-11af50ec-6c26-4b8e-9def-0480a11a4bd1 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:55.684181 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-11af50ec-6c26-4b8e-9def-0480a11a4bd1 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:55.684597 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-11af50ec-6c26-4b8e-9def-0480a11a4bd1 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:55.815967 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-11af50ec-6c26-4b8e-9def-0480a11a4bd1 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8983f4ff039e4f6bbf01159accb1fb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7614eeafc645958e7308586df90b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:36:55.823582 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-11af50ec-6c26-4b8e-9def-0480a11a4bd1 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/e9c550c2-bc03-4e38-a7b7-3035d095deff" status: 200 len: 1266 microversion: 2.1 time: 0.152303 Aug 31 19:36:55.824146 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 630/1261] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:36:55 2022] GET /compute/v2.1/servers/e9c550c2-bc03-4e38-a7b7-3035d095deff => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:36:56.845229 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-b9f076b7-3a75-4e93-85ec-516c4694e488 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:36:56.845847 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-b9f076b7-3a75-4e93-85ec-516c4694e488 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: e9c550c2-bc03-4e38-a7b7-3035d095deff] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:36:56.848471 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell0:SELECT=2 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:36:56.853973 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b9f076b7-3a75-4e93-85ec-516c4694e488 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:56.854461 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b9f076b7-3a75-4e93-85ec-516c4694e488 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:56.854898 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b9f076b7-3a75-4e93-85ec-516c4694e488 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:56.855589 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b9f076b7-3a75-4e93-85ec-516c4694e488 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:56.856044 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b9f076b7-3a75-4e93-85ec-516c4694e488 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:56.856470 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b9f076b7-3a75-4e93-85ec-516c4694e488 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:56.987557 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-b9f076b7-3a75-4e93-85ec-516c4694e488 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8983f4ff039e4f6bbf01159accb1fb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7614eeafc645958e7308586df90b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:36:56.995364 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-b9f076b7-3a75-4e93-85ec-516c4694e488 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/e9c550c2-bc03-4e38-a7b7-3035d095deff" status: 200 len: 1266 microversion: 2.1 time: 0.154876 Aug 31 19:36:56.995933 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 632/1262] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:36:56 2022] GET /compute/v2.1/servers/e9c550c2-bc03-4e38-a7b7-3035d095deff => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:36:58.015752 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-45875746-f940-4fa9-9c3d-39492182a1ae tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:36:58.016367 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-45875746-f940-4fa9-9c3d-39492182a1ae tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: e9c550c2-bc03-4e38-a7b7-3035d095deff] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:36:58.018337 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell0:SELECT=2 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:36:58.019110 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell0:SELECT=6 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:36:58.025476 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-45875746-f940-4fa9-9c3d-39492182a1ae tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:58.025988 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-45875746-f940-4fa9-9c3d-39492182a1ae tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:58.026425 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-45875746-f940-4fa9-9c3d-39492182a1ae tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:58.027111 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-45875746-f940-4fa9-9c3d-39492182a1ae tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:58.027566 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-45875746-f940-4fa9-9c3d-39492182a1ae tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:58.027987 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-45875746-f940-4fa9-9c3d-39492182a1ae tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:58.158961 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-45875746-f940-4fa9-9c3d-39492182a1ae tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8983f4ff039e4f6bbf01159accb1fb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7614eeafc645958e7308586df90b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:36:58.166535 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-45875746-f940-4fa9-9c3d-39492182a1ae tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/e9c550c2-bc03-4e38-a7b7-3035d095deff" status: 200 len: 1266 microversion: 2.1 time: 0.154606 Aug 31 19:36:58.167098 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 631/1263] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:36:58 2022] GET /compute/v2.1/servers/e9c550c2-bc03-4e38-a7b7-3035d095deff => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:36:59.187089 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d91ce1a4-8843-418a-b774-e53c16abdd88 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:36:59.187796 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d91ce1a4-8843-418a-b774-e53c16abdd88 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: e9c550c2-bc03-4e38-a7b7-3035d095deff] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:36:59.194435 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d91ce1a4-8843-418a-b774-e53c16abdd88 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:59.194931 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d91ce1a4-8843-418a-b774-e53c16abdd88 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:59.195376 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d91ce1a4-8843-418a-b774-e53c16abdd88 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:59.196301 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d91ce1a4-8843-418a-b774-e53c16abdd88 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:59.196529 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d91ce1a4-8843-418a-b774-e53c16abdd88 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:59.196956 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d91ce1a4-8843-418a-b774-e53c16abdd88 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:59.328349 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-d91ce1a4-8843-418a-b774-e53c16abdd88 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8983f4ff039e4f6bbf01159accb1fb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7614eeafc645958e7308586df90b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:36:59.336403 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-d91ce1a4-8843-418a-b774-e53c16abdd88 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/e9c550c2-bc03-4e38-a7b7-3035d095deff" status: 200 len: 1266 microversion: 2.1 time: 0.153519 Aug 31 19:36:59.336965 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 633/1264] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:36:59 2022] GET /compute/v2.1/servers/e9c550c2-bc03-4e38-a7b7-3035d095deff => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:37:00.357098 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-6a25a0e6-404c-4802-96b7-6ac173e3f070 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:37:00.358248 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-6a25a0e6-404c-4802-96b7-6ac173e3f070 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: e9c550c2-bc03-4e38-a7b7-3035d095deff] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:37:00.364645 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6a25a0e6-404c-4802-96b7-6ac173e3f070 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:00.365122 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6a25a0e6-404c-4802-96b7-6ac173e3f070 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:00.365586 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6a25a0e6-404c-4802-96b7-6ac173e3f070 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:00.366275 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6a25a0e6-404c-4802-96b7-6ac173e3f070 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:00.366723 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6a25a0e6-404c-4802-96b7-6ac173e3f070 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:00.367144 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6a25a0e6-404c-4802-96b7-6ac173e3f070 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:00.497412 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-6a25a0e6-404c-4802-96b7-6ac173e3f070 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8983f4ff039e4f6bbf01159accb1fb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7614eeafc645958e7308586df90b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:37:00.505785 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-6a25a0e6-404c-4802-96b7-6ac173e3f070 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/e9c550c2-bc03-4e38-a7b7-3035d095deff" status: 200 len: 1266 microversion: 2.1 time: 0.152505 Aug 31 19:37:00.506354 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 632/1265] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:37:00 2022] GET /compute/v2.1/servers/e9c550c2-bc03-4e38-a7b7-3035d095deff => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:37:01.287004 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-e37d98da-d163-43ee-8aca-9c7ea8c05836 req-b5eafa9b-e174-48d2-97c0-2ef84509bdeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9c550c2-bc03-4e38-a7b7-3035d095deff", "name": "network-vif-plugged", "status": "completed", "tag": "c2d492fd-bbe4-4a69-a026-48e4a87afc79"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:37:01.299604 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-e37d98da-d163-43ee-8aca-9c7ea8c05836 req-b5eafa9b-e174-48d2-97c0-2ef84509bdeb service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:01.300109 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-e37d98da-d163-43ee-8aca-9c7ea8c05836 req-b5eafa9b-e174-48d2-97c0-2ef84509bdeb service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:01.300534 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-e37d98da-d163-43ee-8aca-9c7ea8c05836 req-b5eafa9b-e174-48d2-97c0-2ef84509bdeb service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:01.311599 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-e37d98da-d163-43ee-8aca-9c7ea8c05836 req-b5eafa9b-e174-48d2-97c0-2ef84509bdeb service nova] Creating event network-vif-plugged:c2d492fd-bbe4-4a69-a026-48e4a87afc79 for instance e9c550c2-bc03-4e38-a7b7-3035d095deff on hv-cinder-83538 Aug 31 19:37:01.316954 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-e37d98da-d163-43ee-8aca-9c7ea8c05836 req-b5eafa9b-e174-48d2-97c0-2ef84509bdeb service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034094 Aug 31 19:37:01.317773 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 634/1266] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:37:01.526065 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-e662eff3-3c00-42a4-9e63-5a0d29accba4 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:37:01.526760 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-e662eff3-3c00-42a4-9e63-5a0d29accba4 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: e9c550c2-bc03-4e38-a7b7-3035d095deff] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:37:01.533324 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e662eff3-3c00-42a4-9e63-5a0d29accba4 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:01.533901 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e662eff3-3c00-42a4-9e63-5a0d29accba4 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:01.534398 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e662eff3-3c00-42a4-9e63-5a0d29accba4 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:01.535103 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e662eff3-3c00-42a4-9e63-5a0d29accba4 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:01.535547 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e662eff3-3c00-42a4-9e63-5a0d29accba4 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:01.535965 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e662eff3-3c00-42a4-9e63-5a0d29accba4 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:01.691436 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-e662eff3-3c00-42a4-9e63-5a0d29accba4 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8983f4ff039e4f6bbf01159accb1fb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7614eeafc645958e7308586df90b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:37:01.699006 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-e662eff3-3c00-42a4-9e63-5a0d29accba4 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/e9c550c2-bc03-4e38-a7b7-3035d095deff" status: 200 len: 1266 microversion: 2.1 time: 0.176853 Aug 31 19:37:01.699569 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 633/1267] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:37:01 2022] GET /compute/v2.1/servers/e9c550c2-bc03-4e38-a7b7-3035d095deff => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:37:02.720441 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-5e91488d-dfd2-4e72-8d83-9c9e5814ef70 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:37:02.721138 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-5e91488d-dfd2-4e72-8d83-9c9e5814ef70 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: e9c550c2-bc03-4e38-a7b7-3035d095deff] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:37:02.727771 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5e91488d-dfd2-4e72-8d83-9c9e5814ef70 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:02.728249 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5e91488d-dfd2-4e72-8d83-9c9e5814ef70 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:02.728680 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5e91488d-dfd2-4e72-8d83-9c9e5814ef70 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:02.729389 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5e91488d-dfd2-4e72-8d83-9c9e5814ef70 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:02.729838 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5e91488d-dfd2-4e72-8d83-9c9e5814ef70 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:02.730255 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5e91488d-dfd2-4e72-8d83-9c9e5814ef70 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:02.860047 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-5e91488d-dfd2-4e72-8d83-9c9e5814ef70 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8983f4ff039e4f6bbf01159accb1fb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7614eeafc645958e7308586df90b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:37:02.867745 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-5e91488d-dfd2-4e72-8d83-9c9e5814ef70 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/e9c550c2-bc03-4e38-a7b7-3035d095deff" status: 200 len: 1266 microversion: 2.1 time: 0.151506 Aug 31 19:37:02.868306 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 635/1268] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:37:02 2022] GET /compute/v2.1/servers/e9c550c2-bc03-4e38-a7b7-3035d095deff => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:37:03.888548 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-43efa43e-1c06-4fe1-8b70-6925ab0b873b tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:37:03.889170 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-43efa43e-1c06-4fe1-8b70-6925ab0b873b tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: e9c550c2-bc03-4e38-a7b7-3035d095deff] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:37:03.895726 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-43efa43e-1c06-4fe1-8b70-6925ab0b873b tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:03.896207 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-43efa43e-1c06-4fe1-8b70-6925ab0b873b tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:03.896642 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-43efa43e-1c06-4fe1-8b70-6925ab0b873b tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:03.897371 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-43efa43e-1c06-4fe1-8b70-6925ab0b873b tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:03.897823 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-43efa43e-1c06-4fe1-8b70-6925ab0b873b tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:03.898245 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-43efa43e-1c06-4fe1-8b70-6925ab0b873b tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:04.030129 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-43efa43e-1c06-4fe1-8b70-6925ab0b873b tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8983f4ff039e4f6bbf01159accb1fb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7614eeafc645958e7308586df90b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:37:04.037886 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-43efa43e-1c06-4fe1-8b70-6925ab0b873b tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/e9c550c2-bc03-4e38-a7b7-3035d095deff" status: 200 len: 1453 microversion: 2.1 time: 0.153224 Aug 31 19:37:04.038445 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 634/1269] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:37:03 2022] GET /compute/v2.1/servers/e9c550c2-bc03-4e38-a7b7-3035d095deff => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:37:04.059172 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-4aeaec5a-d686-4146-a40e-1fe44d0fc36c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:37:04.059787 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-4aeaec5a-d686-4146-a40e-1fe44d0fc36c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: e9c550c2-bc03-4e38-a7b7-3035d095deff] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:37:04.066084 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4aeaec5a-d686-4146-a40e-1fe44d0fc36c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:04.067548 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4aeaec5a-d686-4146-a40e-1fe44d0fc36c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:04.067979 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4aeaec5a-d686-4146-a40e-1fe44d0fc36c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:04.068705 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4aeaec5a-d686-4146-a40e-1fe44d0fc36c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:04.069156 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4aeaec5a-d686-4146-a40e-1fe44d0fc36c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:04.069603 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4aeaec5a-d686-4146-a40e-1fe44d0fc36c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:04.199015 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-4aeaec5a-d686-4146-a40e-1fe44d0fc36c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8983f4ff039e4f6bbf01159accb1fb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7614eeafc645958e7308586df90b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:37:04.207227 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-4aeaec5a-d686-4146-a40e-1fe44d0fc36c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/e9c550c2-bc03-4e38-a7b7-3035d095deff" status: 200 len: 1453 microversion: 2.1 time: 0.152999 Aug 31 19:37:04.207787 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 636/1270] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:37:04 2022] GET /compute/v2.1/servers/e9c550c2-bc03-4e38-a7b7-3035d095deff => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:37:06.097145 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-d1975a80-d676-45bb-ba28-3bb6e79e6a80 req-604146b6-c43c-4087-b447-358db00a89a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9c550c2-bc03-4e38-a7b7-3035d095deff", "tag": "c2d492fd-bbe4-4a69-a026-48e4a87afc79"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:37:06.106516 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-d1975a80-d676-45bb-ba28-3bb6e79e6a80 req-604146b6-c43c-4087-b447-358db00a89a4 service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:06.106921 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-d1975a80-d676-45bb-ba28-3bb6e79e6a80 req-604146b6-c43c-4087-b447-358db00a89a4 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:06.107338 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-d1975a80-d676-45bb-ba28-3bb6e79e6a80 req-604146b6-c43c-4087-b447-358db00a89a4 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:06.118900 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-d1975a80-d676-45bb-ba28-3bb6e79e6a80 req-604146b6-c43c-4087-b447-358db00a89a4 service nova] Creating event network-changed:c2d492fd-bbe4-4a69-a026-48e4a87afc79 for instance e9c550c2-bc03-4e38-a7b7-3035d095deff on hv-cinder-83538 Aug 31 19:37:06.123856 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-d1975a80-d676-45bb-ba28-3bb6e79e6a80 req-604146b6-c43c-4087-b447-358db00a89a4 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089243 Aug 31 19:37:06.124434 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 635/1271] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:39:22.916851 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4fffa9f7-205b-4e47-82c5-17d2e62cc868] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 31 19:39:22.917503 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=22 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:39:22.918617 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=50 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:39:22.920256 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 19:39:22.920438 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Wed Aug 31 19:39:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e9c550c2-bc03-4e38-a7b7-3035d095deff (ip 10.222.0.65) !!! Aug 31 19:39:22.921686 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 19:39:22.921814 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Wed Aug 31 19:39:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e9c550c2-bc03-4e38-a7b7-3035d095deff (ip 10.222.0.65) !!! Aug 31 19:39:22.926240 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-f184004d-3ce1-493b-b239-d629a4f9d307 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:39:22.926728 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-f184004d-3ce1-493b-b239-d629a4f9d307 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: e9c550c2-bc03-4e38-a7b7-3035d095deff] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:39:22.937023 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f184004d-3ce1-493b-b239-d629a4f9d307 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:22.937522 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f184004d-3ce1-493b-b239-d629a4f9d307 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:22.937949 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f184004d-3ce1-493b-b239-d629a4f9d307 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:22.938625 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f184004d-3ce1-493b-b239-d629a4f9d307 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:22.939070 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f184004d-3ce1-493b-b239-d629a4f9d307 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:22.939482 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f184004d-3ce1-493b-b239-d629a4f9d307 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:22.964917 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-f184004d-3ce1-493b-b239-d629a4f9d307 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: e9c550c2-bc03-4e38-a7b7-3035d095deff] Going to try to terminate instance {{(pid=120623) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 19:39:23.046493 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-f184004d-3ce1-493b-b239-d629a4f9d307 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "DELETE /compute/v2.1/servers/e9c550c2-bc03-4e38-a7b7-3035d095deff" status: 204 len: 0 microversion: 2.1 time: 0.131396 Aug 31 19:39:23.047280 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 637/1272] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 31 19:39:22 2022] DELETE /compute/v2.1/servers/e9c550c2-bc03-4e38-a7b7-3035d095deff => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:39:23.055002 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0f7c495b-5fab-475e-b999-c97a21a2120f] AMQP server on 10.222.0.65:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 31 19:39:23.055620 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:39:23.056386 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=54 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:39:23.063489 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-06520da3-7930-40b3-a6d8-cd70d000314c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:39:23.064175 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-06520da3-7930-40b3-a6d8-cd70d000314c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: e9c550c2-bc03-4e38-a7b7-3035d095deff] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:39:23.071314 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-06520da3-7930-40b3-a6d8-cd70d000314c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:23.071784 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-06520da3-7930-40b3-a6d8-cd70d000314c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:23.072205 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-06520da3-7930-40b3-a6d8-cd70d000314c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:23.072877 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-06520da3-7930-40b3-a6d8-cd70d000314c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:23.073345 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-06520da3-7930-40b3-a6d8-cd70d000314c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:23.073757 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-06520da3-7930-40b3-a6d8-cd70d000314c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:23.252634 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-06520da3-7930-40b3-a6d8-cd70d000314c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8983f4ff039e4f6bbf01159accb1fb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7614eeafc645958e7308586df90b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:39:23.260557 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-06520da3-7930-40b3-a6d8-cd70d000314c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/e9c550c2-bc03-4e38-a7b7-3035d095deff" status: 200 len: 1578 microversion: 2.1 time: 0.208539 Aug 31 19:39:23.261111 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 636/1273] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:39:23 2022] GET /compute/v2.1/servers/e9c550c2-bc03-4e38-a7b7-3035d095deff => generated 1578 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:39:24.283403 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d6e00ba5-8ebc-473d-aa2c-53a8dfec7380 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:39:24.284097 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d6e00ba5-8ebc-473d-aa2c-53a8dfec7380 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: e9c550c2-bc03-4e38-a7b7-3035d095deff] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:39:24.293796 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d6e00ba5-8ebc-473d-aa2c-53a8dfec7380 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:24.294276 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d6e00ba5-8ebc-473d-aa2c-53a8dfec7380 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:24.294705 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d6e00ba5-8ebc-473d-aa2c-53a8dfec7380 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:24.295389 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d6e00ba5-8ebc-473d-aa2c-53a8dfec7380 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:24.295839 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d6e00ba5-8ebc-473d-aa2c-53a8dfec7380 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:24.296259 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d6e00ba5-8ebc-473d-aa2c-53a8dfec7380 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:24.302414 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO oslo.messaging._drivers.impl_rabbit [-] [4fffa9f7-205b-4e47-82c5-17d2e62cc868] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 43554. Aug 31 19:39:24.430186 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-d6e00ba5-8ebc-473d-aa2c-53a8dfec7380 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8983f4ff039e4f6bbf01159accb1fb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7614eeafc645958e7308586df90b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:39:24.437987 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-d6e00ba5-8ebc-473d-aa2c-53a8dfec7380 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/e9c550c2-bc03-4e38-a7b7-3035d095deff" status: 200 len: 1578 microversion: 2.1 time: 0.158825 Aug 31 19:39:24.438555 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 638/1274] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:39:24 2022] GET /compute/v2.1/servers/e9c550c2-bc03-4e38-a7b7-3035d095deff => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:39:25.459125 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-72fdcc15-f6fc-4b05-adde-7e3dd0760f11 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:39:25.459768 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-72fdcc15-f6fc-4b05-adde-7e3dd0760f11 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: e9c550c2-bc03-4e38-a7b7-3035d095deff] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:39:25.468065 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-72fdcc15-f6fc-4b05-adde-7e3dd0760f11 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:25.468548 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-72fdcc15-f6fc-4b05-adde-7e3dd0760f11 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:25.468984 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-72fdcc15-f6fc-4b05-adde-7e3dd0760f11 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:25.469710 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-72fdcc15-f6fc-4b05-adde-7e3dd0760f11 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:25.470177 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-72fdcc15-f6fc-4b05-adde-7e3dd0760f11 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:25.470581 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-72fdcc15-f6fc-4b05-adde-7e3dd0760f11 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:25.487290 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO oslo.messaging._drivers.impl_rabbit [-] [0f7c495b-5fab-475e-b999-c97a21a2120f] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 43560. Aug 31 19:39:25.708231 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-72fdcc15-f6fc-4b05-adde-7e3dd0760f11 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8983f4ff039e4f6bbf01159accb1fb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7614eeafc645958e7308586df90b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:39:25.716131 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-72fdcc15-f6fc-4b05-adde-7e3dd0760f11 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/e9c550c2-bc03-4e38-a7b7-3035d095deff" status: 200 len: 1578 microversion: 2.1 time: 0.261216 Aug 31 19:39:25.716707 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 637/1275] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:39:25 2022] GET /compute/v2.1/servers/e9c550c2-bc03-4e38-a7b7-3035d095deff => generated 1578 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:39:26.168194 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-21a6a04c-dad0-468a-8c57-aedccb21527f req-ec34c9e2-96fa-4489-9a91-747e6a67436d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9c550c2-bc03-4e38-a7b7-3035d095deff", "name": "network-vif-deleted", "tag": "c2d492fd-bbe4-4a69-a026-48e4a87afc79"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:39:26.179341 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-21a6a04c-dad0-468a-8c57-aedccb21527f req-ec34c9e2-96fa-4489-9a91-747e6a67436d service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:26.179831 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-21a6a04c-dad0-468a-8c57-aedccb21527f req-ec34c9e2-96fa-4489-9a91-747e6a67436d service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:26.180265 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-21a6a04c-dad0-468a-8c57-aedccb21527f req-ec34c9e2-96fa-4489-9a91-747e6a67436d service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:26.193318 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-21a6a04c-dad0-468a-8c57-aedccb21527f req-ec34c9e2-96fa-4489-9a91-747e6a67436d service nova] Creating event network-vif-deleted:c2d492fd-bbe4-4a69-a026-48e4a87afc79 for instance e9c550c2-bc03-4e38-a7b7-3035d095deff on hv-cinder-83538 Aug 31 19:39:26.199147 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-21a6a04c-dad0-468a-8c57-aedccb21527f req-ec34c9e2-96fa-4489-9a91-747e6a67436d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097286 Aug 31 19:39:26.200217 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 639/1276] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:39:26.738489 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-45bc4d34-e4bc-4082-aaa5-308a0b5c3b8d tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:39:26.739247 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-45bc4d34-e4bc-4082-aaa5-308a0b5c3b8d tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: e9c550c2-bc03-4e38-a7b7-3035d095deff] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:39:26.746731 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-45bc4d34-e4bc-4082-aaa5-308a0b5c3b8d tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:26.747209 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-45bc4d34-e4bc-4082-aaa5-308a0b5c3b8d tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:26.747634 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-45bc4d34-e4bc-4082-aaa5-308a0b5c3b8d tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:26.748323 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-45bc4d34-e4bc-4082-aaa5-308a0b5c3b8d tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:26.748774 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-45bc4d34-e4bc-4082-aaa5-308a0b5c3b8d tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:26.749196 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-45bc4d34-e4bc-4082-aaa5-308a0b5c3b8d tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:26.781651 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-45bc4d34-e4bc-4082-aaa5-308a0b5c3b8d tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:26.782127 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-45bc4d34-e4bc-4082-aaa5-308a0b5c3b8d tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:26.782551 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-45bc4d34-e4bc-4082-aaa5-308a0b5c3b8d tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:26.782987 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.objects.instance [None req-45bc4d34-e4bc-4082-aaa5-308a0b5c3b8d tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lazy-loading 'fault' on Instance uuid e9c550c2-bc03-4e38-a7b7-3035d095deff {{(pid=120624) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:39:26.823287 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-45bc4d34-e4bc-4082-aaa5-308a0b5c3b8d tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8983f4ff039e4f6bbf01159accb1fb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7614eeafc645958e7308586df90b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:39:26.831422 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-45bc4d34-e4bc-4082-aaa5-308a0b5c3b8d tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/e9c550c2-bc03-4e38-a7b7-3035d095deff" status: 200 len: 1230 microversion: 2.1 time: 0.096801 Aug 31 19:39:26.831971 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 638/1277] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:39:26 2022] GET /compute/v2.1/servers/e9c550c2-bc03-4e38-a7b7-3035d095deff => generated 1230 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:39:27.853067 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-f864e092-cbec-4729-9854-19ea485816ac tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:39:27.853829 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-f864e092-cbec-4729-9854-19ea485816ac tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: e9c550c2-bc03-4e38-a7b7-3035d095deff] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:39:27.859985 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f864e092-cbec-4729-9854-19ea485816ac tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:27.860468 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f864e092-cbec-4729-9854-19ea485816ac tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:27.860901 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f864e092-cbec-4729-9854-19ea485816ac tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:27.861624 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f864e092-cbec-4729-9854-19ea485816ac tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:27.862076 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f864e092-cbec-4729-9854-19ea485816ac tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:27.862502 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f864e092-cbec-4729-9854-19ea485816ac tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:27.876055 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.wsgi [None req-f864e092-cbec-4729-9854-19ea485816ac tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] HTTP exception thrown: Instance e9c550c2-bc03-4e38-a7b7-3035d095deff could not be found. Aug 31 19:39:27.877675 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-f864e092-cbec-4729-9854-19ea485816ac tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Request method failure captured: Aug 31 19:39:27.877675 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: request: GET /compute/v2.1/servers/e9c550c2-bc03-4e38-a7b7-3035d095deff HTTP/1.1 Aug 31 19:39:27.877675 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Accept: application/json Aug 31 19:39:27.877675 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Accept-Encoding: identity Aug 31 19:39:27.877675 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Connection: close Aug 31 19:39:27.877675 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Content-Length: 0 Aug 31 19:39:27.877675 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Content-Type: application/json Aug 31 19:39:27.877675 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Host: 10.222.0.65 Aug 31 19:39:27.877675 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Openstack-System-Scope: None Aug 31 19:39:27.877675 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: User-Agent: python-urllib3/1.26.12 Aug 31 19:39:27.877675 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Auth-Token: gAAAAABjD7gwsH5VZMgDMl8y6FqBAYLnx2bp0y0PQvT8fkHTtKVMRMP4627wc2dYH_-AmY882xS_-ikxkvQEb6iaN4jsJOISI0-mJVnI3lahzm92E-XvGDWpTlus5QtHjARTEwA34gIaA79Q59Exwol_DdqUyy0B6p3v8IRaEs5jHM8DclZMSm4 Aug 31 19:39:27.877675 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Domain-Id: None Aug 31 19:39:27.877675 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Domain-Name: None Aug 31 19:39:27.877675 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Identity-Status: Confirmed Aug 31 19:39:27.877675 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Is-Admin-Project: True Aug 31 19:39:27.877675 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Id: default Aug 31 19:39:27.877675 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Name: Default Aug 31 19:39:27.877675 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Id: 2f7614eeafc645958e7308586df90b8e Aug 31 19:39:27.877675 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Name: tempest-TestVolumeBootPattern-1556101958 Aug 31 19:39:27.877675 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Role: member,reader Aug 31 19:39:27.877675 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Roles: member,reader Aug 31 19:39:27.879517 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2f7614eeafc645958e7308586df90b8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2f7614eeafc645958e7308586df90b8e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2f7614eeafc645958e7308586df90b8e", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2f7614eeafc645958e7308586df90b8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:39:27.879517 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant: tempest-TestVolumeBootPattern-1556101958 Aug 31 19:39:27.879517 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant-Id: 2f7614eeafc645958e7308586df90b8e Aug 31 19:39:27.879517 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant-Name: tempest-TestVolumeBootPattern-1556101958 Aug 31 19:39:27.879517 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User: tempest-TestVolumeBootPattern-1556101958-project Aug 31 19:39:27.879517 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Id: default Aug 31 19:39:27.879517 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Name: Default Aug 31 19:39:27.879517 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Id: 8983f4ff039e4f6bbf01159accb1fb7c Aug 31 19:39:27.879517 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Name: tempest-TestVolumeBootPattern-1556101958-project Aug 31 19:39:27.879517 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: method: > Aug 31 19:39:27.879517 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: exception: Instance e9c550c2-bc03-4e38-a7b7-3035d095deff could not be found. Aug 31 19:39:27.879517 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: action_args: {'id': 'e9c550c2-bc03-4e38-a7b7-3035d095deff'} Aug 31 19:39:27.880775 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:39:27.880775 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:39:27.880775 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:39:27.880775 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:39:27.880775 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:39:27.880775 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:39:27.880775 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:39:27.880775 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:39:27.880775 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:39:27.880775 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:39:27.880775 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9c550c2-bc03-4e38-a7b7-3035d095deff could not be found. Aug 31 19:39:27.880775 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:39:27.880775 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:39:27.880775 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:39:27.880775 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:39:27.880775 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:39:27.880775 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:39:27.880775 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:39:27.880775 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:39:27.880775 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:39:27.882533 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:39:27.882533 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:39:27.882533 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:39:27.882533 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:39:27.882533 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:39:27.882533 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:39:27.882533 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:39:27.882533 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9c550c2-bc03-4e38-a7b7-3035d095deff could not be found. Aug 31 19:39:27.882533 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:39:27.882533 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:39:27.882533 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:39:27.882533 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:39:27.882533 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:39:27.882533 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:39:27.882533 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:39:27.882533 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:39:27.882533 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9c550c2-bc03-4e38-a7b7-3035d095deff could not be found. Aug 31 19:39:27.882533 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:39:27.884093 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-f864e092-cbec-4729-9854-19ea485816ac tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Returning 404 to user: Instance e9c550c2-bc03-4e38-a7b7-3035d095deff could not be found. {{(pid=120623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:39:27.884093 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-f864e092-cbec-4729-9854-19ea485816ac tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/e9c550c2-bc03-4e38-a7b7-3035d095deff" status: 404 len: 111 microversion: 2.1 time: 0.030732 Aug 31 19:39:27.884093 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 640/1278] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:39:27 2022] GET /compute/v2.1/servers/e9c550c2-bc03-4e38-a7b7-3035d095deff => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 19:39:27.925854 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-fab2a5db-ef51-4164-8bbd-d55320847ccb tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1162722903", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-735888209", "security_groups": [{"name": "tempest-secgroup-smoke-1884254819"}], "block_device_mapping_v2": [{"uuid": "d624cb6e-b3cd-44d5-b5f2-4083737f05b2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "12c490a0-1e02-4358-9614-c12af23b9c0c"}]}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:39:28.036921 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.network.neutron [None req-fab2a5db-ef51-4164-8bbd-d55320847ccb tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] validate_networks() for [('12c490a0-1e02-4358-9614-c12af23b9c0c', None, None, None, None, None)] {{(pid=120624) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:39:28.398638 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-fab2a5db-ef51-4164-8bbd-d55320847ccb tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Flavor limits 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:39:28.399060 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-fab2a5db-ef51-4164-8bbd-d55320847ccb tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Image limits 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:39:28.399532 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-fab2a5db-ef51-4164-8bbd-d55320847ccb tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Flavor pref 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:39:28.399945 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-fab2a5db-ef51-4164-8bbd-d55320847ccb tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Image pref 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:39:28.400351 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-fab2a5db-ef51-4164-8bbd-d55320847ccb tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:39:28.410008 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fab2a5db-ef51-4164-8bbd-d55320847ccb tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:28.410479 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fab2a5db-ef51-4164-8bbd-d55320847ccb tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:28.411034 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fab2a5db-ef51-4164-8bbd-d55320847ccb tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:28.411748 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fab2a5db-ef51-4164-8bbd-d55320847ccb tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:28.412194 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fab2a5db-ef51-4164-8bbd-d55320847ccb tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:28.412604 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fab2a5db-ef51-4164-8bbd-d55320847ccb tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:28.428747 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-fab2a5db-ef51-4164-8bbd-d55320847ccb tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Getting quotas for project 2f7614eeafc645958e7308586df90b8e. Resources: {'instances', 'cores', 'ram'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:39:28.432625 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-fab2a5db-ef51-4164-8bbd-d55320847ccb tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Getting quotas for user 8983f4ff039e4f6bbf01159accb1fb7c and project 2f7614eeafc645958e7308586df90b8e. Resources: {'instances', 'cores', 'ram'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:39:28.489428 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-fab2a5db-ef51-4164-8bbd-d55320847ccb tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Going to run 1 instances... {{(pid=120624) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:39:28.491545 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-fab2a5db-ef51-4164-8bbd-d55320847ccb tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: bba8eb34-9578-4c3a-87be-44f0c9fcad5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d624cb6e-b3cd-44d5-b5f2-4083737f05b2',volume_size=None,volume_type=None)] {{(pid=120624) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:39:28.617389 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-fab2a5db-ef51-4164-8bbd-d55320847ccb tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.695313 Aug 31 19:39:28.618136 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 639/1279] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 31 19:39:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 19:39:28.629389 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-db3e7b45-81cd-4047-9f30-fe15c3508084 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:39:28.629991 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-db3e7b45-81cd-4047-9f30-fe15c3508084 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: bba8eb34-9578-4c3a-87be-44f0c9fcad5d] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:39:28.682641 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-db3e7b45-81cd-4047-9f30-fe15c3508084 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8983f4ff039e4f6bbf01159accb1fb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7614eeafc645958e7308586df90b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:39:28.689946 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-db3e7b45-81cd-4047-9f30-fe15c3508084 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/bba8eb34-9578-4c3a-87be-44f0c9fcad5d" status: 200 len: 1094 microversion: 2.1 time: 0.064520 Aug 31 19:39:28.690490 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 641/1280] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:39:28 2022] GET /compute/v2.1/servers/bba8eb34-9578-4c3a-87be-44f0c9fcad5d => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:39:29.711377 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-9197e57f-8e30-4025-a99d-b3e5a42aeca9 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:39:29.712001 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-9197e57f-8e30-4025-a99d-b3e5a42aeca9 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: bba8eb34-9578-4c3a-87be-44f0c9fcad5d] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:39:29.719686 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9197e57f-8e30-4025-a99d-b3e5a42aeca9 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:29.720715 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9197e57f-8e30-4025-a99d-b3e5a42aeca9 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:29.721522 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9197e57f-8e30-4025-a99d-b3e5a42aeca9 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:29.722051 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9197e57f-8e30-4025-a99d-b3e5a42aeca9 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:29.722568 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9197e57f-8e30-4025-a99d-b3e5a42aeca9 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:29.723061 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9197e57f-8e30-4025-a99d-b3e5a42aeca9 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:29.798512 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-9197e57f-8e30-4025-a99d-b3e5a42aeca9 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8983f4ff039e4f6bbf01159accb1fb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7614eeafc645958e7308586df90b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:39:29.806263 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-9197e57f-8e30-4025-a99d-b3e5a42aeca9 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/bba8eb34-9578-4c3a-87be-44f0c9fcad5d" status: 200 len: 1210 microversion: 2.1 time: 0.099482 Aug 31 19:39:29.806825 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 640/1281] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:39:29 2022] GET /compute/v2.1/servers/bba8eb34-9578-4c3a-87be-44f0c9fcad5d => generated 1210 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:39:30.827347 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-f4f2a5db-def4-4da5-90bd-79151b36e137 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:39:30.827891 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-f4f2a5db-def4-4da5-90bd-79151b36e137 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: bba8eb34-9578-4c3a-87be-44f0c9fcad5d] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:39:30.835199 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f4f2a5db-def4-4da5-90bd-79151b36e137 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:30.835683 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f4f2a5db-def4-4da5-90bd-79151b36e137 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:30.836111 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f4f2a5db-def4-4da5-90bd-79151b36e137 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:30.836799 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f4f2a5db-def4-4da5-90bd-79151b36e137 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:30.837273 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f4f2a5db-def4-4da5-90bd-79151b36e137 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:30.837747 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f4f2a5db-def4-4da5-90bd-79151b36e137 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:30.975984 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-f4f2a5db-def4-4da5-90bd-79151b36e137 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8983f4ff039e4f6bbf01159accb1fb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7614eeafc645958e7308586df90b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:39:30.984542 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-f4f2a5db-def4-4da5-90bd-79151b36e137 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/bba8eb34-9578-4c3a-87be-44f0c9fcad5d" status: 200 len: 1266 microversion: 2.1 time: 0.161520 Aug 31 19:39:30.985590 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 642/1282] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:39:30 2022] GET /compute/v2.1/servers/bba8eb34-9578-4c3a-87be-44f0c9fcad5d => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:39:31.076768 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-b589b96e-e506-4643-a084-bfb04710c876 req-39e53d33-a019-40b2-8ebc-8da02590b103 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bba8eb34-9578-4c3a-87be-44f0c9fcad5d", "tag": "f7163f92-b218-4fa7-a8b6-e22840f86ef5"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:39:31.090312 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-b589b96e-e506-4643-a084-bfb04710c876 req-39e53d33-a019-40b2-8ebc-8da02590b103 service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:31.091078 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-b589b96e-e506-4643-a084-bfb04710c876 req-39e53d33-a019-40b2-8ebc-8da02590b103 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:31.091546 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-b589b96e-e506-4643-a084-bfb04710c876 req-39e53d33-a019-40b2-8ebc-8da02590b103 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:31.103545 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-b589b96e-e506-4643-a084-bfb04710c876 req-39e53d33-a019-40b2-8ebc-8da02590b103 service nova] Creating event network-changed:f7163f92-b218-4fa7-a8b6-e22840f86ef5 for instance bba8eb34-9578-4c3a-87be-44f0c9fcad5d on hv-cinder-83538 Aug 31 19:39:31.109736 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-b589b96e-e506-4643-a084-bfb04710c876 req-39e53d33-a019-40b2-8ebc-8da02590b103 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036490 Aug 31 19:39:31.110601 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 641/1283] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:39:32.005594 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-be6a5fd0-390d-454b-aa8b-99eab2b210f9 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:39:32.006222 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-be6a5fd0-390d-454b-aa8b-99eab2b210f9 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: bba8eb34-9578-4c3a-87be-44f0c9fcad5d] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:39:32.013048 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-be6a5fd0-390d-454b-aa8b-99eab2b210f9 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:32.013886 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-be6a5fd0-390d-454b-aa8b-99eab2b210f9 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:32.014327 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-be6a5fd0-390d-454b-aa8b-99eab2b210f9 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:32.015011 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-be6a5fd0-390d-454b-aa8b-99eab2b210f9 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:32.015464 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-be6a5fd0-390d-454b-aa8b-99eab2b210f9 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:32.015885 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-be6a5fd0-390d-454b-aa8b-99eab2b210f9 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:32.147294 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-be6a5fd0-390d-454b-aa8b-99eab2b210f9 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8983f4ff039e4f6bbf01159accb1fb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7614eeafc645958e7308586df90b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:39:32.155500 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-be6a5fd0-390d-454b-aa8b-99eab2b210f9 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/bba8eb34-9578-4c3a-87be-44f0c9fcad5d" status: 200 len: 1266 microversion: 2.1 time: 0.153729 Aug 31 19:39:32.156060 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 643/1284] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:39:32 2022] GET /compute/v2.1/servers/bba8eb34-9578-4c3a-87be-44f0c9fcad5d => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:39:33.176730 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-f1031ef5-c5c2-4d5f-842f-66e37b95e86a tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:39:33.177535 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-f1031ef5-c5c2-4d5f-842f-66e37b95e86a tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: bba8eb34-9578-4c3a-87be-44f0c9fcad5d] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:39:33.183727 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f1031ef5-c5c2-4d5f-842f-66e37b95e86a tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:33.184213 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f1031ef5-c5c2-4d5f-842f-66e37b95e86a tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:33.184643 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f1031ef5-c5c2-4d5f-842f-66e37b95e86a tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:33.185351 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f1031ef5-c5c2-4d5f-842f-66e37b95e86a tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:33.185802 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f1031ef5-c5c2-4d5f-842f-66e37b95e86a tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:33.186217 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f1031ef5-c5c2-4d5f-842f-66e37b95e86a tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:33.317122 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-f1031ef5-c5c2-4d5f-842f-66e37b95e86a tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8983f4ff039e4f6bbf01159accb1fb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7614eeafc645958e7308586df90b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:39:33.324806 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-f1031ef5-c5c2-4d5f-842f-66e37b95e86a tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/bba8eb34-9578-4c3a-87be-44f0c9fcad5d" status: 200 len: 1266 microversion: 2.1 time: 0.152769 Aug 31 19:39:33.325400 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 642/1285] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:39:33 2022] GET /compute/v2.1/servers/bba8eb34-9578-4c3a-87be-44f0c9fcad5d => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:39:34.344712 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-bb0429ac-9689-47cf-9971-44f01a64ab20 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:39:34.345318 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-bb0429ac-9689-47cf-9971-44f01a64ab20 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: bba8eb34-9578-4c3a-87be-44f0c9fcad5d] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:39:34.351958 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bb0429ac-9689-47cf-9971-44f01a64ab20 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:34.352444 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bb0429ac-9689-47cf-9971-44f01a64ab20 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:34.352883 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bb0429ac-9689-47cf-9971-44f01a64ab20 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:34.353617 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bb0429ac-9689-47cf-9971-44f01a64ab20 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:34.354058 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bb0429ac-9689-47cf-9971-44f01a64ab20 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:34.354477 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bb0429ac-9689-47cf-9971-44f01a64ab20 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:34.485468 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-bb0429ac-9689-47cf-9971-44f01a64ab20 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8983f4ff039e4f6bbf01159accb1fb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7614eeafc645958e7308586df90b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:39:34.493119 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-bb0429ac-9689-47cf-9971-44f01a64ab20 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/bba8eb34-9578-4c3a-87be-44f0c9fcad5d" status: 200 len: 1266 microversion: 2.1 time: 0.152328 Aug 31 19:39:34.493701 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 644/1286] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:39:34 2022] GET /compute/v2.1/servers/bba8eb34-9578-4c3a-87be-44f0c9fcad5d => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:39:35.514086 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-e186418d-2b06-44d1-910f-9f0a768b7e5c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:39:35.514688 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-e186418d-2b06-44d1-910f-9f0a768b7e5c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: bba8eb34-9578-4c3a-87be-44f0c9fcad5d] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:39:35.521136 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e186418d-2b06-44d1-910f-9f0a768b7e5c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:35.521685 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e186418d-2b06-44d1-910f-9f0a768b7e5c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:35.522116 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e186418d-2b06-44d1-910f-9f0a768b7e5c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:35.522835 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e186418d-2b06-44d1-910f-9f0a768b7e5c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:35.523287 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e186418d-2b06-44d1-910f-9f0a768b7e5c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:35.523705 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e186418d-2b06-44d1-910f-9f0a768b7e5c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:35.651482 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-e186418d-2b06-44d1-910f-9f0a768b7e5c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8983f4ff039e4f6bbf01159accb1fb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7614eeafc645958e7308586df90b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:39:35.659140 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-e186418d-2b06-44d1-910f-9f0a768b7e5c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/bba8eb34-9578-4c3a-87be-44f0c9fcad5d" status: 200 len: 1266 microversion: 2.1 time: 0.149543 Aug 31 19:39:35.659734 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 643/1287] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:39:35 2022] GET /compute/v2.1/servers/bba8eb34-9578-4c3a-87be-44f0c9fcad5d => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:39:36.679876 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-33713059-3a79-45dd-ae73-18931cc32e64 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:39:36.680484 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-33713059-3a79-45dd-ae73-18931cc32e64 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: bba8eb34-9578-4c3a-87be-44f0c9fcad5d] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:39:36.686897 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-33713059-3a79-45dd-ae73-18931cc32e64 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:36.687376 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-33713059-3a79-45dd-ae73-18931cc32e64 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:36.687805 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-33713059-3a79-45dd-ae73-18931cc32e64 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:36.688484 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-33713059-3a79-45dd-ae73-18931cc32e64 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:36.688935 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-33713059-3a79-45dd-ae73-18931cc32e64 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:36.689384 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-33713059-3a79-45dd-ae73-18931cc32e64 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:36.835764 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-33713059-3a79-45dd-ae73-18931cc32e64 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8983f4ff039e4f6bbf01159accb1fb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7614eeafc645958e7308586df90b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:39:36.843354 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-33713059-3a79-45dd-ae73-18931cc32e64 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/bba8eb34-9578-4c3a-87be-44f0c9fcad5d" status: 200 len: 1266 microversion: 2.1 time: 0.167318 Aug 31 19:39:36.843919 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 645/1288] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:39:36 2022] GET /compute/v2.1/servers/bba8eb34-9578-4c3a-87be-44f0c9fcad5d => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:39:37.863772 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-2a328cea-ae62-40c0-b546-429e2576eef8 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:39:37.864333 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-2a328cea-ae62-40c0-b546-429e2576eef8 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: bba8eb34-9578-4c3a-87be-44f0c9fcad5d] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:39:37.870626 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2a328cea-ae62-40c0-b546-429e2576eef8 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:37.871161 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2a328cea-ae62-40c0-b546-429e2576eef8 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:37.871582 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2a328cea-ae62-40c0-b546-429e2576eef8 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:37.872250 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2a328cea-ae62-40c0-b546-429e2576eef8 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:37.872689 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2a328cea-ae62-40c0-b546-429e2576eef8 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:37.873098 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2a328cea-ae62-40c0-b546-429e2576eef8 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:38.004221 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-2a328cea-ae62-40c0-b546-429e2576eef8 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8983f4ff039e4f6bbf01159accb1fb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7614eeafc645958e7308586df90b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:39:38.012316 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-2a328cea-ae62-40c0-b546-429e2576eef8 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/bba8eb34-9578-4c3a-87be-44f0c9fcad5d" status: 200 len: 1266 microversion: 2.1 time: 0.152504 Aug 31 19:39:38.012881 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 644/1289] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:39:37 2022] GET /compute/v2.1/servers/bba8eb34-9578-4c3a-87be-44f0c9fcad5d => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:39:39.033206 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-c0701d1c-e2a1-45c6-85f8-6668ef4deb09 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:39:39.033824 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-c0701d1c-e2a1-45c6-85f8-6668ef4deb09 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: bba8eb34-9578-4c3a-87be-44f0c9fcad5d] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:39:39.036303 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell0:SELECT=2 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:39:39.041828 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c0701d1c-e2a1-45c6-85f8-6668ef4deb09 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:39.042311 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c0701d1c-e2a1-45c6-85f8-6668ef4deb09 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:39.043538 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c0701d1c-e2a1-45c6-85f8-6668ef4deb09 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:39.044718 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c0701d1c-e2a1-45c6-85f8-6668ef4deb09 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:39.045532 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c0701d1c-e2a1-45c6-85f8-6668ef4deb09 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:39.045965 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c0701d1c-e2a1-45c6-85f8-6668ef4deb09 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:39.222451 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-c0701d1c-e2a1-45c6-85f8-6668ef4deb09 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8983f4ff039e4f6bbf01159accb1fb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7614eeafc645958e7308586df90b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:39:39.230908 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-c0701d1c-e2a1-45c6-85f8-6668ef4deb09 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/bba8eb34-9578-4c3a-87be-44f0c9fcad5d" status: 200 len: 1266 microversion: 2.1 time: 0.200901 Aug 31 19:39:39.231466 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 646/1290] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:39:39 2022] GET /compute/v2.1/servers/bba8eb34-9578-4c3a-87be-44f0c9fcad5d => generated 1266 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:39:40.251752 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-956be3fd-5180-4690-8a0e-094b5d85aacb tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:39:40.252382 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-956be3fd-5180-4690-8a0e-094b5d85aacb tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: bba8eb34-9578-4c3a-87be-44f0c9fcad5d] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:39:40.254308 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell0:SELECT=2 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:39:40.254971 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell0:SELECT=6 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:39:40.261258 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-956be3fd-5180-4690-8a0e-094b5d85aacb tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:40.261728 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-956be3fd-5180-4690-8a0e-094b5d85aacb tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:40.262148 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-956be3fd-5180-4690-8a0e-094b5d85aacb tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:40.262821 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-956be3fd-5180-4690-8a0e-094b5d85aacb tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:40.263259 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-956be3fd-5180-4690-8a0e-094b5d85aacb tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:40.263671 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-956be3fd-5180-4690-8a0e-094b5d85aacb tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:40.394852 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-956be3fd-5180-4690-8a0e-094b5d85aacb tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8983f4ff039e4f6bbf01159accb1fb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7614eeafc645958e7308586df90b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:39:40.402404 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-956be3fd-5180-4690-8a0e-094b5d85aacb tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/bba8eb34-9578-4c3a-87be-44f0c9fcad5d" status: 200 len: 1266 microversion: 2.1 time: 0.154442 Aug 31 19:39:40.402972 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 645/1291] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:39:40 2022] GET /compute/v2.1/servers/bba8eb34-9578-4c3a-87be-44f0c9fcad5d => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:39:41.422909 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-adaeb533-467c-448f-a891-e8bde8aa4013 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:39:41.423503 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-adaeb533-467c-448f-a891-e8bde8aa4013 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: bba8eb34-9578-4c3a-87be-44f0c9fcad5d] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:39:41.439963 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-adaeb533-467c-448f-a891-e8bde8aa4013 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:41.440439 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-adaeb533-467c-448f-a891-e8bde8aa4013 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:41.440864 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-adaeb533-467c-448f-a891-e8bde8aa4013 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:41.441636 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-adaeb533-467c-448f-a891-e8bde8aa4013 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:41.442080 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-adaeb533-467c-448f-a891-e8bde8aa4013 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:41.442493 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-adaeb533-467c-448f-a891-e8bde8aa4013 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:41.578235 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-adaeb533-467c-448f-a891-e8bde8aa4013 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8983f4ff039e4f6bbf01159accb1fb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7614eeafc645958e7308586df90b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:39:41.586089 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-adaeb533-467c-448f-a891-e8bde8aa4013 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/bba8eb34-9578-4c3a-87be-44f0c9fcad5d" status: 200 len: 1266 microversion: 2.1 time: 0.167149 Aug 31 19:39:41.586657 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 647/1292] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:39:41 2022] GET /compute/v2.1/servers/bba8eb34-9578-4c3a-87be-44f0c9fcad5d => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:39:42.116448 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-a1f677b9-0e37-434b-96a4-7ebced889c59 req-6e024623-7282-4b4b-9949-bd7e80e4dca1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bba8eb34-9578-4c3a-87be-44f0c9fcad5d", "name": "network-vif-plugged", "status": "completed", "tag": "f7163f92-b218-4fa7-a8b6-e22840f86ef5"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:39:42.126345 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-a1f677b9-0e37-434b-96a4-7ebced889c59 req-6e024623-7282-4b4b-9949-bd7e80e4dca1 service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:42.126823 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-a1f677b9-0e37-434b-96a4-7ebced889c59 req-6e024623-7282-4b4b-9949-bd7e80e4dca1 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:42.127245 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-a1f677b9-0e37-434b-96a4-7ebced889c59 req-6e024623-7282-4b4b-9949-bd7e80e4dca1 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:42.140591 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-a1f677b9-0e37-434b-96a4-7ebced889c59 req-6e024623-7282-4b4b-9949-bd7e80e4dca1 service nova] Creating event network-vif-plugged:f7163f92-b218-4fa7-a8b6-e22840f86ef5 for instance bba8eb34-9578-4c3a-87be-44f0c9fcad5d on hv-cinder-83538 Aug 31 19:39:42.145528 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-a1f677b9-0e37-434b-96a4-7ebced889c59 req-6e024623-7282-4b4b-9949-bd7e80e4dca1 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089179 Aug 31 19:39:42.146105 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 646/1293] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:39:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:39:42.606463 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-b4c585f1-b44a-4cb1-8080-c771d9bcbf4c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:39:42.607069 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-b4c585f1-b44a-4cb1-8080-c771d9bcbf4c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: bba8eb34-9578-4c3a-87be-44f0c9fcad5d] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:39:42.613408 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b4c585f1-b44a-4cb1-8080-c771d9bcbf4c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:42.613891 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b4c585f1-b44a-4cb1-8080-c771d9bcbf4c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:42.614316 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b4c585f1-b44a-4cb1-8080-c771d9bcbf4c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:42.614994 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b4c585f1-b44a-4cb1-8080-c771d9bcbf4c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:42.615438 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b4c585f1-b44a-4cb1-8080-c771d9bcbf4c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:42.615852 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b4c585f1-b44a-4cb1-8080-c771d9bcbf4c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:42.745007 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-b4c585f1-b44a-4cb1-8080-c771d9bcbf4c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8983f4ff039e4f6bbf01159accb1fb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7614eeafc645958e7308586df90b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:39:42.753519 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-b4c585f1-b44a-4cb1-8080-c771d9bcbf4c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/bba8eb34-9578-4c3a-87be-44f0c9fcad5d" status: 200 len: 1266 microversion: 2.1 time: 0.150849 Aug 31 19:39:42.754082 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 648/1294] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:39:42 2022] GET /compute/v2.1/servers/bba8eb34-9578-4c3a-87be-44f0c9fcad5d => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:39:43.774868 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-5bde7bb7-9ed9-4212-a9b0-0591c317fd65 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:39:43.775564 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-5bde7bb7-9ed9-4212-a9b0-0591c317fd65 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: bba8eb34-9578-4c3a-87be-44f0c9fcad5d] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:39:43.782379 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5bde7bb7-9ed9-4212-a9b0-0591c317fd65 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:43.782856 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5bde7bb7-9ed9-4212-a9b0-0591c317fd65 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:43.783286 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5bde7bb7-9ed9-4212-a9b0-0591c317fd65 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:43.783976 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5bde7bb7-9ed9-4212-a9b0-0591c317fd65 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:43.784424 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5bde7bb7-9ed9-4212-a9b0-0591c317fd65 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:43.784842 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5bde7bb7-9ed9-4212-a9b0-0591c317fd65 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:43.916939 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-5bde7bb7-9ed9-4212-a9b0-0591c317fd65 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8983f4ff039e4f6bbf01159accb1fb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7614eeafc645958e7308586df90b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:39:43.924731 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-5bde7bb7-9ed9-4212-a9b0-0591c317fd65 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/bba8eb34-9578-4c3a-87be-44f0c9fcad5d" status: 200 len: 1266 microversion: 2.1 time: 0.154540 Aug 31 19:39:43.925316 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 647/1295] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:39:43 2022] GET /compute/v2.1/servers/bba8eb34-9578-4c3a-87be-44f0c9fcad5d => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:39:44.944699 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-65633b81-de35-4c3f-a09d-a17544d2abea tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:39:44.945330 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-65633b81-de35-4c3f-a09d-a17544d2abea tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: bba8eb34-9578-4c3a-87be-44f0c9fcad5d] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:39:44.951720 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-65633b81-de35-4c3f-a09d-a17544d2abea tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:44.952200 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-65633b81-de35-4c3f-a09d-a17544d2abea tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:44.952644 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-65633b81-de35-4c3f-a09d-a17544d2abea tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:44.953340 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-65633b81-de35-4c3f-a09d-a17544d2abea tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:44.953791 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-65633b81-de35-4c3f-a09d-a17544d2abea tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:44.954208 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-65633b81-de35-4c3f-a09d-a17544d2abea tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:45.084648 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-65633b81-de35-4c3f-a09d-a17544d2abea tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8983f4ff039e4f6bbf01159accb1fb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7614eeafc645958e7308586df90b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:39:45.092819 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-65633b81-de35-4c3f-a09d-a17544d2abea tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/bba8eb34-9578-4c3a-87be-44f0c9fcad5d" status: 200 len: 1453 microversion: 2.1 time: 0.151967 Aug 31 19:39:45.093417 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 649/1296] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:39:44 2022] GET /compute/v2.1/servers/bba8eb34-9578-4c3a-87be-44f0c9fcad5d => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:39:45.112763 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-88360715-de76-43f8-9ef4-da2235cd6f40 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:39:45.113488 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-88360715-de76-43f8-9ef4-da2235cd6f40 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: bba8eb34-9578-4c3a-87be-44f0c9fcad5d] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:39:45.119817 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-88360715-de76-43f8-9ef4-da2235cd6f40 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:45.120300 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-88360715-de76-43f8-9ef4-da2235cd6f40 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:45.120731 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-88360715-de76-43f8-9ef4-da2235cd6f40 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:45.121443 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-88360715-de76-43f8-9ef4-da2235cd6f40 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:45.121984 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-88360715-de76-43f8-9ef4-da2235cd6f40 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:45.122403 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-88360715-de76-43f8-9ef4-da2235cd6f40 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:45.254225 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-88360715-de76-43f8-9ef4-da2235cd6f40 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8983f4ff039e4f6bbf01159accb1fb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7614eeafc645958e7308586df90b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:39:45.262550 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-88360715-de76-43f8-9ef4-da2235cd6f40 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/bba8eb34-9578-4c3a-87be-44f0c9fcad5d" status: 200 len: 1453 microversion: 2.1 time: 0.153413 Aug 31 19:39:45.263459 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 648/1297] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:39:45 2022] GET /compute/v2.1/servers/bba8eb34-9578-4c3a-87be-44f0c9fcad5d => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:39:47.096794 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-e05b1320-a661-4152-ade0-9a044bc6265f req-baf15ac7-a5cc-407f-80d3-704829d0de2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bba8eb34-9578-4c3a-87be-44f0c9fcad5d", "tag": "f7163f92-b218-4fa7-a8b6-e22840f86ef5"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:39:47.107112 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-e05b1320-a661-4152-ade0-9a044bc6265f req-baf15ac7-a5cc-407f-80d3-704829d0de2c service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:47.107588 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-e05b1320-a661-4152-ade0-9a044bc6265f req-baf15ac7-a5cc-407f-80d3-704829d0de2c service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:47.108019 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-e05b1320-a661-4152-ade0-9a044bc6265f req-baf15ac7-a5cc-407f-80d3-704829d0de2c service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:47.118929 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-e05b1320-a661-4152-ade0-9a044bc6265f req-baf15ac7-a5cc-407f-80d3-704829d0de2c service nova] Creating event network-changed:f7163f92-b218-4fa7-a8b6-e22840f86ef5 for instance bba8eb34-9578-4c3a-87be-44f0c9fcad5d on hv-cinder-83538 Aug 31 19:39:47.124076 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-e05b1320-a661-4152-ade0-9a044bc6265f req-baf15ac7-a5cc-407f-80d3-704829d0de2c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030957 Aug 31 19:39:47.124676 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 650/1298] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:41:46.733024 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:46.733792 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=68 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:46.734852 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 19:41:46.734991 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Wed Aug 31 19:41:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.65) !!! Aug 31 19:41:46.736426 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 19:41:46.736556 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Wed Aug 31 19:41:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.65) !!! Aug 31 19:41:46.741822 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-e7fc0ff1-2ecc-4f8d-af79-458a0588a613 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-498991164", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-735888209", "security_groups": [{"name": "tempest-secgroup-smoke-1884254819"}], "block_device_mapping_v2": [{"uuid": "c390c13e-215b-4370-859c-48f0455108f9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "12c490a0-1e02-4358-9614-c12af23b9c0c"}]}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:41:46.856899 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.network.neutron [None req-e7fc0ff1-2ecc-4f8d-af79-458a0588a613 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] validate_networks() for [('12c490a0-1e02-4358-9614-c12af23b9c0c', None, None, None, None, None)] {{(pid=120624) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:41:47.264678 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-e7fc0ff1-2ecc-4f8d-af79-458a0588a613 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Flavor limits 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:41:47.265089 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-e7fc0ff1-2ecc-4f8d-af79-458a0588a613 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Image limits 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:41:47.265577 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-e7fc0ff1-2ecc-4f8d-af79-458a0588a613 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Flavor pref 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:41:47.265975 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-e7fc0ff1-2ecc-4f8d-af79-458a0588a613 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Image pref 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:41:47.266374 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-e7fc0ff1-2ecc-4f8d-af79-458a0588a613 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:41:47.275063 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e7fc0ff1-2ecc-4f8d-af79-458a0588a613 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:47.275531 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e7fc0ff1-2ecc-4f8d-af79-458a0588a613 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:47.275956 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e7fc0ff1-2ecc-4f8d-af79-458a0588a613 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:47.276668 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e7fc0ff1-2ecc-4f8d-af79-458a0588a613 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:47.277111 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e7fc0ff1-2ecc-4f8d-af79-458a0588a613 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:47.277567 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e7fc0ff1-2ecc-4f8d-af79-458a0588a613 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:47.294159 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-e7fc0ff1-2ecc-4f8d-af79-458a0588a613 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Getting quotas for project 2f7614eeafc645958e7308586df90b8e. Resources: {'instances', 'cores', 'ram'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:41:47.297995 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-e7fc0ff1-2ecc-4f8d-af79-458a0588a613 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Getting quotas for user 8983f4ff039e4f6bbf01159accb1fb7c and project 2f7614eeafc645958e7308586df90b8e. Resources: {'instances', 'cores', 'ram'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:41:47.354089 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-e7fc0ff1-2ecc-4f8d-af79-458a0588a613 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Going to run 1 instances... {{(pid=120624) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:41:47.356193 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-e7fc0ff1-2ecc-4f8d-af79-458a0588a613 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: 86ec5d65-dd6e-4578-ad1e-588cdf8cfa22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c390c13e-215b-4370-859c-48f0455108f9',volume_size=None,volume_type=None)] {{(pid=120624) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:41:47.485198 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-e7fc0ff1-2ecc-4f8d-af79-458a0588a613 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.753994 Aug 31 19:41:47.485871 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 649/1299] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 31 19:41:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 19:41:47.502088 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4fffa9f7-205b-4e47-82c5-17d2e62cc868] AMQP server on 10.222.0.65:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 31 19:41:47.503029 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:47.503800 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:47.509581 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-a93eef9f-77e3-45e2-880d-1afb08663275 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:41:47.510270 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-a93eef9f-77e3-45e2-880d-1afb08663275 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: 86ec5d65-dd6e-4578-ad1e-588cdf8cfa22] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:41:47.568634 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-a93eef9f-77e3-45e2-880d-1afb08663275 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8983f4ff039e4f6bbf01159accb1fb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7614eeafc645958e7308586df90b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:41:47.575393 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-a93eef9f-77e3-45e2-880d-1afb08663275 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/86ec5d65-dd6e-4578-ad1e-588cdf8cfa22" status: 200 len: 1093 microversion: 2.1 time: 0.076571 Aug 31 19:41:47.575954 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 651/1300] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:41:47 2022] GET /compute/v2.1/servers/86ec5d65-dd6e-4578-ad1e-588cdf8cfa22 => generated 1093 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:41:48.596160 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-3d37e81f-0fec-402e-827a-44388a3ee6bd tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:41:48.596740 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-3d37e81f-0fec-402e-827a-44388a3ee6bd tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: 86ec5d65-dd6e-4578-ad1e-588cdf8cfa22] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:41:48.602818 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3d37e81f-0fec-402e-827a-44388a3ee6bd tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:48.603296 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3d37e81f-0fec-402e-827a-44388a3ee6bd tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:48.603725 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3d37e81f-0fec-402e-827a-44388a3ee6bd tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:48.604403 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3d37e81f-0fec-402e-827a-44388a3ee6bd tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:48.604856 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3d37e81f-0fec-402e-827a-44388a3ee6bd tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:48.605303 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3d37e81f-0fec-402e-827a-44388a3ee6bd tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:48.666875 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-3d37e81f-0fec-402e-827a-44388a3ee6bd tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8983f4ff039e4f6bbf01159accb1fb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7614eeafc645958e7308586df90b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:41:48.675622 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-3d37e81f-0fec-402e-827a-44388a3ee6bd tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/86ec5d65-dd6e-4578-ad1e-588cdf8cfa22" status: 200 len: 1191 microversion: 2.1 time: 0.083925 Aug 31 19:41:48.676196 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 650/1301] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:41:48 2022] GET /compute/v2.1/servers/86ec5d65-dd6e-4578-ad1e-588cdf8cfa22 => generated 1191 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:41:49.696534 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-baf0d313-5bea-4a03-98f9-45cdb84287d3 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:41:49.697119 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-baf0d313-5bea-4a03-98f9-45cdb84287d3 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: 86ec5d65-dd6e-4578-ad1e-588cdf8cfa22] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:41:49.708486 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO oslo.messaging._drivers.impl_rabbit [-] [4fffa9f7-205b-4e47-82c5-17d2e62cc868] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 43746. Aug 31 19:41:49.715377 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-baf0d313-5bea-4a03-98f9-45cdb84287d3 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:49.715870 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-baf0d313-5bea-4a03-98f9-45cdb84287d3 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:49.716307 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-baf0d313-5bea-4a03-98f9-45cdb84287d3 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:49.717634 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-baf0d313-5bea-4a03-98f9-45cdb84287d3 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:49.718094 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-baf0d313-5bea-4a03-98f9-45cdb84287d3 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:49.718717 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-baf0d313-5bea-4a03-98f9-45cdb84287d3 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:49.854354 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-baf0d313-5bea-4a03-98f9-45cdb84287d3 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8983f4ff039e4f6bbf01159accb1fb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7614eeafc645958e7308586df90b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:41:49.862154 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-baf0d313-5bea-4a03-98f9-45cdb84287d3 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/86ec5d65-dd6e-4578-ad1e-588cdf8cfa22" status: 200 len: 1265 microversion: 2.1 time: 0.170075 Aug 31 19:41:49.862718 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 652/1302] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:41:49 2022] GET /compute/v2.1/servers/86ec5d65-dd6e-4578-ad1e-588cdf8cfa22 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:41:50.109975 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-03533435-37c2-4e61-bbee-055a73cadff2 req-a1d8f83f-2379-4970-8cfa-a9b281d0ea95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86ec5d65-dd6e-4578-ad1e-588cdf8cfa22", "tag": "6c4e96d2-db95-49be-ba55-d93e1caab39a"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:41:50.124203 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-03533435-37c2-4e61-bbee-055a73cadff2 req-a1d8f83f-2379-4970-8cfa-a9b281d0ea95 service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:50.124686 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-03533435-37c2-4e61-bbee-055a73cadff2 req-a1d8f83f-2379-4970-8cfa-a9b281d0ea95 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:50.125095 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-03533435-37c2-4e61-bbee-055a73cadff2 req-a1d8f83f-2379-4970-8cfa-a9b281d0ea95 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:50.136653 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-03533435-37c2-4e61-bbee-055a73cadff2 req-a1d8f83f-2379-4970-8cfa-a9b281d0ea95 service nova] Creating event network-changed:6c4e96d2-db95-49be-ba55-d93e1caab39a for instance 86ec5d65-dd6e-4578-ad1e-588cdf8cfa22 on hv-cinder-83538 Aug 31 19:41:50.141844 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-03533435-37c2-4e61-bbee-055a73cadff2 req-a1d8f83f-2379-4970-8cfa-a9b281d0ea95 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035742 Aug 31 19:41:50.142559 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 651/1303] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:41:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:41:50.882453 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-b9405cc3-b183-436a-af83-feabcf7a4276 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:41:50.883033 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-b9405cc3-b183-436a-af83-feabcf7a4276 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: 86ec5d65-dd6e-4578-ad1e-588cdf8cfa22] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:41:50.889941 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b9405cc3-b183-436a-af83-feabcf7a4276 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:50.890426 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b9405cc3-b183-436a-af83-feabcf7a4276 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:50.890854 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b9405cc3-b183-436a-af83-feabcf7a4276 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:50.891545 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b9405cc3-b183-436a-af83-feabcf7a4276 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:50.891994 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b9405cc3-b183-436a-af83-feabcf7a4276 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:50.892417 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b9405cc3-b183-436a-af83-feabcf7a4276 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:51.025361 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-b9405cc3-b183-436a-af83-feabcf7a4276 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8983f4ff039e4f6bbf01159accb1fb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7614eeafc645958e7308586df90b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:41:51.032951 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-b9405cc3-b183-436a-af83-feabcf7a4276 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/86ec5d65-dd6e-4578-ad1e-588cdf8cfa22" status: 200 len: 1265 microversion: 2.1 time: 0.154439 Aug 31 19:41:51.033538 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 653/1304] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:41:50 2022] GET /compute/v2.1/servers/86ec5d65-dd6e-4578-ad1e-588cdf8cfa22 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:41:52.057979 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-a844ff99-3445-4fcb-856c-a1a74a7d9062 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:41:52.058632 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-a844ff99-3445-4fcb-856c-a1a74a7d9062 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: 86ec5d65-dd6e-4578-ad1e-588cdf8cfa22] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:41:52.065065 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a844ff99-3445-4fcb-856c-a1a74a7d9062 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:52.065577 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a844ff99-3445-4fcb-856c-a1a74a7d9062 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:52.066012 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a844ff99-3445-4fcb-856c-a1a74a7d9062 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:52.066700 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a844ff99-3445-4fcb-856c-a1a74a7d9062 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:52.067149 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a844ff99-3445-4fcb-856c-a1a74a7d9062 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:52.067576 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a844ff99-3445-4fcb-856c-a1a74a7d9062 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:52.195348 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-a844ff99-3445-4fcb-856c-a1a74a7d9062 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8983f4ff039e4f6bbf01159accb1fb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7614eeafc645958e7308586df90b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:41:52.203131 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-a844ff99-3445-4fcb-856c-a1a74a7d9062 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/86ec5d65-dd6e-4578-ad1e-588cdf8cfa22" status: 200 len: 1265 microversion: 2.1 time: 0.150596 Aug 31 19:41:52.203695 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 652/1305] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:41:52 2022] GET /compute/v2.1/servers/86ec5d65-dd6e-4578-ad1e-588cdf8cfa22 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:41:53.224599 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-0d27942a-4dc2-4e96-b101-f993aaa5e09b tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:41:53.225230 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-0d27942a-4dc2-4e96-b101-f993aaa5e09b tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: 86ec5d65-dd6e-4578-ad1e-588cdf8cfa22] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:41:53.231607 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0d27942a-4dc2-4e96-b101-f993aaa5e09b tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:53.232088 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0d27942a-4dc2-4e96-b101-f993aaa5e09b tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:53.232515 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0d27942a-4dc2-4e96-b101-f993aaa5e09b tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:53.233220 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0d27942a-4dc2-4e96-b101-f993aaa5e09b tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:53.233673 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0d27942a-4dc2-4e96-b101-f993aaa5e09b tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:53.234092 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0d27942a-4dc2-4e96-b101-f993aaa5e09b tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:53.365805 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-0d27942a-4dc2-4e96-b101-f993aaa5e09b tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8983f4ff039e4f6bbf01159accb1fb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7614eeafc645958e7308586df90b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:41:53.374266 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-0d27942a-4dc2-4e96-b101-f993aaa5e09b tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/86ec5d65-dd6e-4578-ad1e-588cdf8cfa22" status: 200 len: 1265 microversion: 2.1 time: 0.153489 Aug 31 19:41:53.374828 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 654/1306] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:41:53 2022] GET /compute/v2.1/servers/86ec5d65-dd6e-4578-ad1e-588cdf8cfa22 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:41:54.394369 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-87c54279-963a-488b-a514-e98559b94770 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:41:54.394968 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-87c54279-963a-488b-a514-e98559b94770 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: 86ec5d65-dd6e-4578-ad1e-588cdf8cfa22] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:41:54.401893 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-87c54279-963a-488b-a514-e98559b94770 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:54.402378 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-87c54279-963a-488b-a514-e98559b94770 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:54.402809 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-87c54279-963a-488b-a514-e98559b94770 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:54.403502 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-87c54279-963a-488b-a514-e98559b94770 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:54.403953 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-87c54279-963a-488b-a514-e98559b94770 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:54.404370 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-87c54279-963a-488b-a514-e98559b94770 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:54.535742 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-87c54279-963a-488b-a514-e98559b94770 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8983f4ff039e4f6bbf01159accb1fb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7614eeafc645958e7308586df90b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:41:54.544051 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-87c54279-963a-488b-a514-e98559b94770 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/86ec5d65-dd6e-4578-ad1e-588cdf8cfa22" status: 200 len: 1265 microversion: 2.1 time: 0.153530 Aug 31 19:41:54.544616 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 653/1307] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:41:54 2022] GET /compute/v2.1/servers/86ec5d65-dd6e-4578-ad1e-588cdf8cfa22 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:41:55.565619 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-9b0c5b32-1ea8-4fdc-9577-46c08f38545c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:41:55.566246 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-9b0c5b32-1ea8-4fdc-9577-46c08f38545c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: 86ec5d65-dd6e-4578-ad1e-588cdf8cfa22] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:41:55.572498 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9b0c5b32-1ea8-4fdc-9577-46c08f38545c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:55.572975 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9b0c5b32-1ea8-4fdc-9577-46c08f38545c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:55.573436 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9b0c5b32-1ea8-4fdc-9577-46c08f38545c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:55.574114 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9b0c5b32-1ea8-4fdc-9577-46c08f38545c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:55.574560 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9b0c5b32-1ea8-4fdc-9577-46c08f38545c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:55.574975 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9b0c5b32-1ea8-4fdc-9577-46c08f38545c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:55.711601 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-9b0c5b32-1ea8-4fdc-9577-46c08f38545c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8983f4ff039e4f6bbf01159accb1fb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7614eeafc645958e7308586df90b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:41:55.719349 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-9b0c5b32-1ea8-4fdc-9577-46c08f38545c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/86ec5d65-dd6e-4578-ad1e-588cdf8cfa22" status: 200 len: 1265 microversion: 2.1 time: 0.157548 Aug 31 19:41:55.719922 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 655/1308] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:41:55 2022] GET /compute/v2.1/servers/86ec5d65-dd6e-4578-ad1e-588cdf8cfa22 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:41:56.740434 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-045345b7-d2b0-4b4e-bcf2-c803dd153250 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:41:56.741038 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-045345b7-d2b0-4b4e-bcf2-c803dd153250 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: 86ec5d65-dd6e-4578-ad1e-588cdf8cfa22] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:41:56.747505 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-045345b7-d2b0-4b4e-bcf2-c803dd153250 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:56.747989 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-045345b7-d2b0-4b4e-bcf2-c803dd153250 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:56.748421 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-045345b7-d2b0-4b4e-bcf2-c803dd153250 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:56.749105 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-045345b7-d2b0-4b4e-bcf2-c803dd153250 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:56.749591 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-045345b7-d2b0-4b4e-bcf2-c803dd153250 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:56.750009 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-045345b7-d2b0-4b4e-bcf2-c803dd153250 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:56.876614 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-045345b7-d2b0-4b4e-bcf2-c803dd153250 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8983f4ff039e4f6bbf01159accb1fb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7614eeafc645958e7308586df90b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:41:56.884794 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-045345b7-d2b0-4b4e-bcf2-c803dd153250 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/86ec5d65-dd6e-4578-ad1e-588cdf8cfa22" status: 200 len: 1265 microversion: 2.1 time: 0.148542 Aug 31 19:41:56.885386 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 654/1309] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:41:56 2022] GET /compute/v2.1/servers/86ec5d65-dd6e-4578-ad1e-588cdf8cfa22 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:41:57.905324 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-94fcc3d0-c2b7-44b5-9f39-fc2ddce0aa24 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:41:57.906029 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-94fcc3d0-c2b7-44b5-9f39-fc2ddce0aa24 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: 86ec5d65-dd6e-4578-ad1e-588cdf8cfa22] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:41:57.908525 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell0:SELECT=2 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:57.914112 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-94fcc3d0-c2b7-44b5-9f39-fc2ddce0aa24 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:57.914599 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-94fcc3d0-c2b7-44b5-9f39-fc2ddce0aa24 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:57.915035 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-94fcc3d0-c2b7-44b5-9f39-fc2ddce0aa24 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:57.916075 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-94fcc3d0-c2b7-44b5-9f39-fc2ddce0aa24 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:57.916535 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-94fcc3d0-c2b7-44b5-9f39-fc2ddce0aa24 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:57.916962 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-94fcc3d0-c2b7-44b5-9f39-fc2ddce0aa24 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:58.044258 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-94fcc3d0-c2b7-44b5-9f39-fc2ddce0aa24 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8983f4ff039e4f6bbf01159accb1fb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7614eeafc645958e7308586df90b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:41:58.051862 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-94fcc3d0-c2b7-44b5-9f39-fc2ddce0aa24 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/86ec5d65-dd6e-4578-ad1e-588cdf8cfa22" status: 200 len: 1265 microversion: 2.1 time: 0.150577 Aug 31 19:41:58.052430 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 656/1310] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:41:57 2022] GET /compute/v2.1/servers/86ec5d65-dd6e-4578-ad1e-588cdf8cfa22 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:41:59.072681 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-edb59c0d-1979-46e8-997b-365a3ecae0a2 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:41:59.073322 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-edb59c0d-1979-46e8-997b-365a3ecae0a2 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: 86ec5d65-dd6e-4578-ad1e-588cdf8cfa22] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:41:59.075138 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell0:SELECT=2 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:59.075785 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell0:SELECT=6 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:59.083093 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-edb59c0d-1979-46e8-997b-365a3ecae0a2 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:59.083570 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-edb59c0d-1979-46e8-997b-365a3ecae0a2 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:59.084000 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-edb59c0d-1979-46e8-997b-365a3ecae0a2 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:59.084689 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-edb59c0d-1979-46e8-997b-365a3ecae0a2 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:59.085138 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-edb59c0d-1979-46e8-997b-365a3ecae0a2 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:59.085580 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-edb59c0d-1979-46e8-997b-365a3ecae0a2 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:59.215776 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-edb59c0d-1979-46e8-997b-365a3ecae0a2 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8983f4ff039e4f6bbf01159accb1fb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7614eeafc645958e7308586df90b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:41:59.223568 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-edb59c0d-1979-46e8-997b-365a3ecae0a2 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/86ec5d65-dd6e-4578-ad1e-588cdf8cfa22" status: 200 len: 1265 microversion: 2.1 time: 0.155598 Aug 31 19:41:59.224136 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 655/1311] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:41:59 2022] GET /compute/v2.1/servers/86ec5d65-dd6e-4578-ad1e-588cdf8cfa22 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:42:00.243945 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-72d63d0f-dd4c-4fd2-9461-db7e67c5ea4b tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:42:00.244561 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-72d63d0f-dd4c-4fd2-9461-db7e67c5ea4b tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: 86ec5d65-dd6e-4578-ad1e-588cdf8cfa22] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:42:00.251009 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-72d63d0f-dd4c-4fd2-9461-db7e67c5ea4b tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:00.251499 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-72d63d0f-dd4c-4fd2-9461-db7e67c5ea4b tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:00.251936 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-72d63d0f-dd4c-4fd2-9461-db7e67c5ea4b tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:00.252628 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-72d63d0f-dd4c-4fd2-9461-db7e67c5ea4b tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:00.253087 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-72d63d0f-dd4c-4fd2-9461-db7e67c5ea4b tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:00.253547 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-72d63d0f-dd4c-4fd2-9461-db7e67c5ea4b tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:00.384154 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-72d63d0f-dd4c-4fd2-9461-db7e67c5ea4b tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8983f4ff039e4f6bbf01159accb1fb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7614eeafc645958e7308586df90b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:42:00.392039 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-72d63d0f-dd4c-4fd2-9461-db7e67c5ea4b tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/86ec5d65-dd6e-4578-ad1e-588cdf8cfa22" status: 200 len: 1265 microversion: 2.1 time: 0.151941 Aug 31 19:42:00.392612 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 657/1312] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:42:00 2022] GET /compute/v2.1/servers/86ec5d65-dd6e-4578-ad1e-588cdf8cfa22 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:42:00.730442 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-bb229b4a-0e07-48de-b879-d2553e18d6a0 req-ed441264-2732-4e18-9b1b-c70d1d2eb9ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86ec5d65-dd6e-4578-ad1e-588cdf8cfa22", "name": "network-vif-plugged", "status": "completed", "tag": "6c4e96d2-db95-49be-ba55-d93e1caab39a"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:42:00.740416 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-bb229b4a-0e07-48de-b879-d2553e18d6a0 req-ed441264-2732-4e18-9b1b-c70d1d2eb9ff service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:00.740888 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-bb229b4a-0e07-48de-b879-d2553e18d6a0 req-ed441264-2732-4e18-9b1b-c70d1d2eb9ff service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:00.741335 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-bb229b4a-0e07-48de-b879-d2553e18d6a0 req-ed441264-2732-4e18-9b1b-c70d1d2eb9ff service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:00.753449 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-bb229b4a-0e07-48de-b879-d2553e18d6a0 req-ed441264-2732-4e18-9b1b-c70d1d2eb9ff service nova] Creating event network-vif-plugged:6c4e96d2-db95-49be-ba55-d93e1caab39a for instance 86ec5d65-dd6e-4578-ad1e-588cdf8cfa22 on hv-cinder-83538 Aug 31 19:42:00.759305 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-bb229b4a-0e07-48de-b879-d2553e18d6a0 req-ed441264-2732-4e18-9b1b-c70d1d2eb9ff service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032019 Aug 31 19:42:00.759893 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 656/1313] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:42:01.411935 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-c46d0a1d-8050-405e-ab9e-9ab3b1eaf19c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:42:01.412612 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-c46d0a1d-8050-405e-ab9e-9ab3b1eaf19c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: 86ec5d65-dd6e-4578-ad1e-588cdf8cfa22] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:42:01.418963 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c46d0a1d-8050-405e-ab9e-9ab3b1eaf19c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:01.419439 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c46d0a1d-8050-405e-ab9e-9ab3b1eaf19c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:01.419865 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c46d0a1d-8050-405e-ab9e-9ab3b1eaf19c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:01.420539 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c46d0a1d-8050-405e-ab9e-9ab3b1eaf19c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:01.420985 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c46d0a1d-8050-405e-ab9e-9ab3b1eaf19c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:01.421428 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c46d0a1d-8050-405e-ab9e-9ab3b1eaf19c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:01.558743 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-c46d0a1d-8050-405e-ab9e-9ab3b1eaf19c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8983f4ff039e4f6bbf01159accb1fb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7614eeafc645958e7308586df90b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:42:01.566306 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-c46d0a1d-8050-405e-ab9e-9ab3b1eaf19c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/86ec5d65-dd6e-4578-ad1e-588cdf8cfa22" status: 200 len: 1265 microversion: 2.1 time: 0.158345 Aug 31 19:42:01.566869 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 658/1314] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:42:01 2022] GET /compute/v2.1/servers/86ec5d65-dd6e-4578-ad1e-588cdf8cfa22 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:42:02.588282 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-f6996513-7679-42f8-86b0-30d5b9c2f678 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:42:02.588983 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-f6996513-7679-42f8-86b0-30d5b9c2f678 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: 86ec5d65-dd6e-4578-ad1e-588cdf8cfa22] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:42:02.595136 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f6996513-7679-42f8-86b0-30d5b9c2f678 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:02.595614 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f6996513-7679-42f8-86b0-30d5b9c2f678 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:02.596046 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f6996513-7679-42f8-86b0-30d5b9c2f678 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:02.596730 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f6996513-7679-42f8-86b0-30d5b9c2f678 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:02.597180 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f6996513-7679-42f8-86b0-30d5b9c2f678 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:02.597622 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f6996513-7679-42f8-86b0-30d5b9c2f678 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:02.727024 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-f6996513-7679-42f8-86b0-30d5b9c2f678 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8983f4ff039e4f6bbf01159accb1fb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7614eeafc645958e7308586df90b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:42:02.734624 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-f6996513-7679-42f8-86b0-30d5b9c2f678 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/86ec5d65-dd6e-4578-ad1e-588cdf8cfa22" status: 200 len: 1265 microversion: 2.1 time: 0.151659 Aug 31 19:42:02.735202 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 657/1315] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:42:02 2022] GET /compute/v2.1/servers/86ec5d65-dd6e-4578-ad1e-588cdf8cfa22 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:42:03.755651 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-8a85a7d7-b09b-41cf-9f81-0001607785df tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:42:03.756257 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-8a85a7d7-b09b-41cf-9f81-0001607785df tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: 86ec5d65-dd6e-4578-ad1e-588cdf8cfa22] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:42:03.763142 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8a85a7d7-b09b-41cf-9f81-0001607785df tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:03.763626 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8a85a7d7-b09b-41cf-9f81-0001607785df tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:03.764059 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8a85a7d7-b09b-41cf-9f81-0001607785df tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:03.764745 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8a85a7d7-b09b-41cf-9f81-0001607785df tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:03.765214 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8a85a7d7-b09b-41cf-9f81-0001607785df tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:03.765645 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8a85a7d7-b09b-41cf-9f81-0001607785df tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:03.893430 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-8a85a7d7-b09b-41cf-9f81-0001607785df tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8983f4ff039e4f6bbf01159accb1fb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7614eeafc645958e7308586df90b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:42:03.901687 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-8a85a7d7-b09b-41cf-9f81-0001607785df tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/86ec5d65-dd6e-4578-ad1e-588cdf8cfa22" status: 200 len: 1453 microversion: 2.1 time: 0.150006 Aug 31 19:42:03.902257 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 659/1316] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:42:03 2022] GET /compute/v2.1/servers/86ec5d65-dd6e-4578-ad1e-588cdf8cfa22 => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:42:03.921081 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-b4516b3e-61b9-4d4b-812b-1d3eb483a9d1 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:42:03.921724 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-b4516b3e-61b9-4d4b-812b-1d3eb483a9d1 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: 86ec5d65-dd6e-4578-ad1e-588cdf8cfa22] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:42:03.927946 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b4516b3e-61b9-4d4b-812b-1d3eb483a9d1 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:03.928418 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b4516b3e-61b9-4d4b-812b-1d3eb483a9d1 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:03.928838 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b4516b3e-61b9-4d4b-812b-1d3eb483a9d1 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:03.929543 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b4516b3e-61b9-4d4b-812b-1d3eb483a9d1 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:03.929982 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b4516b3e-61b9-4d4b-812b-1d3eb483a9d1 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:03.930483 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b4516b3e-61b9-4d4b-812b-1d3eb483a9d1 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:04.060992 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-b4516b3e-61b9-4d4b-812b-1d3eb483a9d1 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8983f4ff039e4f6bbf01159accb1fb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7614eeafc645958e7308586df90b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:42:04.068715 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-b4516b3e-61b9-4d4b-812b-1d3eb483a9d1 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/86ec5d65-dd6e-4578-ad1e-588cdf8cfa22" status: 200 len: 1453 microversion: 2.1 time: 0.151481 Aug 31 19:42:04.069296 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 658/1317] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:42:03 2022] GET /compute/v2.1/servers/86ec5d65-dd6e-4578-ad1e-588cdf8cfa22 => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:42:05.685285 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-c3eff11f-0e95-42a7-b8b2-8e170f8a5959 req-66dbee16-e659-4120-ae39-b70513cb9eee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86ec5d65-dd6e-4578-ad1e-588cdf8cfa22", "tag": "6c4e96d2-db95-49be-ba55-d93e1caab39a"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:42:05.694879 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-c3eff11f-0e95-42a7-b8b2-8e170f8a5959 req-66dbee16-e659-4120-ae39-b70513cb9eee service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:05.695614 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-c3eff11f-0e95-42a7-b8b2-8e170f8a5959 req-66dbee16-e659-4120-ae39-b70513cb9eee service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:05.696614 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-c3eff11f-0e95-42a7-b8b2-8e170f8a5959 req-66dbee16-e659-4120-ae39-b70513cb9eee service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:05.710371 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-c3eff11f-0e95-42a7-b8b2-8e170f8a5959 req-66dbee16-e659-4120-ae39-b70513cb9eee service nova] Creating event network-changed:6c4e96d2-db95-49be-ba55-d93e1caab39a for instance 86ec5d65-dd6e-4578-ad1e-588cdf8cfa22 on hv-cinder-83538 Aug 31 19:42:05.715312 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-c3eff11f-0e95-42a7-b8b2-8e170f8a5959 req-66dbee16-e659-4120-ae39-b70513cb9eee service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033730 Aug 31 19:42:05.715905 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 660/1318] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:42:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:43:57.010694 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4fffa9f7-205b-4e47-82c5-17d2e62cc868] AMQP server on 10.222.0.65:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 31 19:43:57.011329 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=22 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:43:57.012005 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=50 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:43:57.013717 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:43:57.014570 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=48 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:43:57.017448 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 19:43:57.017628 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Wed Aug 31 19:43:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.65) !!! Aug 31 19:43:57.022223 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-cdb3e751-ecfa-484b-9795-35c2b96a68aa tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:43:57.023193 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 19:43:57.023317 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Wed Aug 31 19:43:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.65) !!! Aug 31 19:43:57.029166 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-cdb3e751-ecfa-484b-9795-35c2b96a68aa tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: 86ec5d65-dd6e-4578-ad1e-588cdf8cfa22] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:43:57.044797 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-76de48a1-f977-461e-9b75-4209357f065d req-af3ea67c-3f42-4d58-aa8c-d6585d2424cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86ec5d65-dd6e-4578-ad1e-588cdf8cfa22", "tag": "6c4e96d2-db95-49be-ba55-d93e1caab39a"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:43:57.047418 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cdb3e751-ecfa-484b-9795-35c2b96a68aa tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:57.048050 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cdb3e751-ecfa-484b-9795-35c2b96a68aa tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:57.048684 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cdb3e751-ecfa-484b-9795-35c2b96a68aa tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:57.049414 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cdb3e751-ecfa-484b-9795-35c2b96a68aa tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:57.049859 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cdb3e751-ecfa-484b-9795-35c2b96a68aa tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:57.050458 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cdb3e751-ecfa-484b-9795-35c2b96a68aa tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:57.055075 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-76de48a1-f977-461e-9b75-4209357f065d req-af3ea67c-3f42-4d58-aa8c-d6585d2424cd service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:57.055779 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-76de48a1-f977-461e-9b75-4209357f065d req-af3ea67c-3f42-4d58-aa8c-d6585d2424cd service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:57.056213 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-76de48a1-f977-461e-9b75-4209357f065d req-af3ea67c-3f42-4d58-aa8c-d6585d2424cd service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:57.067212 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-76de48a1-f977-461e-9b75-4209357f065d req-af3ea67c-3f42-4d58-aa8c-d6585d2424cd service nova] Creating event network-changed:6c4e96d2-db95-49be-ba55-d93e1caab39a for instance 86ec5d65-dd6e-4578-ad1e-588cdf8cfa22 on hv-cinder-83538 Aug 31 19:43:57.076182 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-76de48a1-f977-461e-9b75-4209357f065d req-af3ea67c-3f42-4d58-aa8c-d6585d2424cd service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067827 Aug 31 19:43:57.078274 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 661/1319] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:43:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:43:57.078673 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-cdb3e751-ecfa-484b-9795-35c2b96a68aa tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: 86ec5d65-dd6e-4578-ad1e-588cdf8cfa22] Going to try to terminate instance {{(pid=120624) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 19:43:57.168379 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-cdb3e751-ecfa-484b-9795-35c2b96a68aa tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "DELETE /compute/v2.1/servers/86ec5d65-dd6e-4578-ad1e-588cdf8cfa22" status: 204 len: 0 microversion: 2.1 time: 0.162426 Aug 31 19:43:57.180439 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-0328bcde-165c-4cd5-a81f-e6a3b376db5b tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:43:57.181159 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-0328bcde-165c-4cd5-a81f-e6a3b376db5b tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: 86ec5d65-dd6e-4578-ad1e-588cdf8cfa22] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:43:57.184046 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 659/1320] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 31 19:43:57 2022] DELETE /compute/v2.1/servers/86ec5d65-dd6e-4578-ad1e-588cdf8cfa22 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:43:57.187811 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0328bcde-165c-4cd5-a81f-e6a3b376db5b tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:57.188309 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0328bcde-165c-4cd5-a81f-e6a3b376db5b tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:57.188735 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0328bcde-165c-4cd5-a81f-e6a3b376db5b tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:57.189456 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0328bcde-165c-4cd5-a81f-e6a3b376db5b tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:57.189910 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0328bcde-165c-4cd5-a81f-e6a3b376db5b tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:57.190337 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0328bcde-165c-4cd5-a81f-e6a3b376db5b tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:57.331085 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-0328bcde-165c-4cd5-a81f-e6a3b376db5b tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8983f4ff039e4f6bbf01159accb1fb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7614eeafc645958e7308586df90b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:43:57.338819 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-0328bcde-165c-4cd5-a81f-e6a3b376db5b tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/86ec5d65-dd6e-4578-ad1e-588cdf8cfa22" status: 200 len: 1578 microversion: 2.1 time: 0.163849 Aug 31 19:43:57.339384 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 662/1321] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:43:57 2022] GET /compute/v2.1/servers/86ec5d65-dd6e-4578-ad1e-588cdf8cfa22 => generated 1578 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:43:58.363241 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-e3b94359-31d1-4209-b023-1032b56c55fe tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:43:58.364802 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-e3b94359-31d1-4209-b023-1032b56c55fe tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: 86ec5d65-dd6e-4578-ad1e-588cdf8cfa22] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:43:58.372478 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e3b94359-31d1-4209-b023-1032b56c55fe tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:58.372966 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e3b94359-31d1-4209-b023-1032b56c55fe tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:58.373436 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e3b94359-31d1-4209-b023-1032b56c55fe tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:58.374780 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e3b94359-31d1-4209-b023-1032b56c55fe tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:58.375240 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e3b94359-31d1-4209-b023-1032b56c55fe tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:58.375662 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e3b94359-31d1-4209-b023-1032b56c55fe tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:58.513565 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-e3b94359-31d1-4209-b023-1032b56c55fe tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8983f4ff039e4f6bbf01159accb1fb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7614eeafc645958e7308586df90b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:43:58.521273 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-e3b94359-31d1-4209-b023-1032b56c55fe tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/86ec5d65-dd6e-4578-ad1e-588cdf8cfa22" status: 200 len: 1578 microversion: 2.1 time: 0.164029 Aug 31 19:43:58.521844 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 660/1322] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:43:58 2022] GET /compute/v2.1/servers/86ec5d65-dd6e-4578-ad1e-588cdf8cfa22 => generated 1578 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:43:59.541143 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-7483a433-140b-462e-b8cc-962446a8c2bd tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:43:59.541781 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-7483a433-140b-462e-b8cc-962446a8c2bd tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: 86ec5d65-dd6e-4578-ad1e-588cdf8cfa22] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:43:59.550080 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7483a433-140b-462e-b8cc-962446a8c2bd tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:59.550561 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7483a433-140b-462e-b8cc-962446a8c2bd tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:59.550995 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7483a433-140b-462e-b8cc-962446a8c2bd tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:59.551681 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7483a433-140b-462e-b8cc-962446a8c2bd tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:59.552141 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7483a433-140b-462e-b8cc-962446a8c2bd tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:59.552563 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7483a433-140b-462e-b8cc-962446a8c2bd tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:59.558754 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO oslo.messaging._drivers.impl_rabbit [-] [4fffa9f7-205b-4e47-82c5-17d2e62cc868] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 43852. Aug 31 19:43:59.684535 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-7483a433-140b-462e-b8cc-962446a8c2bd tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8983f4ff039e4f6bbf01159accb1fb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7614eeafc645958e7308586df90b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:43:59.692653 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-7483a433-140b-462e-b8cc-962446a8c2bd tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/86ec5d65-dd6e-4578-ad1e-588cdf8cfa22" status: 200 len: 1578 microversion: 2.1 time: 0.155311 Aug 31 19:43:59.693288 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 663/1323] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:43:59 2022] GET /compute/v2.1/servers/86ec5d65-dd6e-4578-ad1e-588cdf8cfa22 => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:44:00.083535 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-f38f1a64-f196-47b8-a1fc-b64db95e1c81 req-658817ea-e057-4981-b60f-5c10734c111a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86ec5d65-dd6e-4578-ad1e-588cdf8cfa22", "name": "network-vif-deleted", "tag": "6c4e96d2-db95-49be-ba55-d93e1caab39a"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:44:00.094743 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-f38f1a64-f196-47b8-a1fc-b64db95e1c81 req-658817ea-e057-4981-b60f-5c10734c111a service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:00.095205 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-f38f1a64-f196-47b8-a1fc-b64db95e1c81 req-658817ea-e057-4981-b60f-5c10734c111a service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:00.095622 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-f38f1a64-f196-47b8-a1fc-b64db95e1c81 req-658817ea-e057-4981-b60f-5c10734c111a service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:00.109864 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-f38f1a64-f196-47b8-a1fc-b64db95e1c81 req-658817ea-e057-4981-b60f-5c10734c111a service nova] Creating event network-vif-deleted:6c4e96d2-db95-49be-ba55-d93e1caab39a for instance 86ec5d65-dd6e-4578-ad1e-588cdf8cfa22 on hv-cinder-83538 Aug 31 19:44:00.115479 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-f38f1a64-f196-47b8-a1fc-b64db95e1c81 req-658817ea-e057-4981-b60f-5c10734c111a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035893 Aug 31 19:44:00.116070 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 661/1324] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:44:00.713512 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d054605a-fe28-4663-be40-afbaa4be6934 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:00.714127 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d054605a-fe28-4663-be40-afbaa4be6934 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: 86ec5d65-dd6e-4578-ad1e-588cdf8cfa22] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:00.721062 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d054605a-fe28-4663-be40-afbaa4be6934 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:00.721577 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d054605a-fe28-4663-be40-afbaa4be6934 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:00.722010 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d054605a-fe28-4663-be40-afbaa4be6934 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:00.722692 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d054605a-fe28-4663-be40-afbaa4be6934 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:00.723141 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d054605a-fe28-4663-be40-afbaa4be6934 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:00.723561 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d054605a-fe28-4663-be40-afbaa4be6934 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:00.752996 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d054605a-fe28-4663-be40-afbaa4be6934 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:00.753504 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d054605a-fe28-4663-be40-afbaa4be6934 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:00.753936 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d054605a-fe28-4663-be40-afbaa4be6934 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:00.754371 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.objects.instance [None req-d054605a-fe28-4663-be40-afbaa4be6934 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lazy-loading 'fault' on Instance uuid 86ec5d65-dd6e-4578-ad1e-588cdf8cfa22 {{(pid=120623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:44:00.795224 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-d054605a-fe28-4663-be40-afbaa4be6934 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8983f4ff039e4f6bbf01159accb1fb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7614eeafc645958e7308586df90b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:44:00.802878 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-d054605a-fe28-4663-be40-afbaa4be6934 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/86ec5d65-dd6e-4578-ad1e-588cdf8cfa22" status: 200 len: 1229 microversion: 2.1 time: 0.093128 Aug 31 19:44:00.803433 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 664/1325] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:44:00 2022] GET /compute/v2.1/servers/86ec5d65-dd6e-4578-ad1e-588cdf8cfa22 => generated 1229 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:44:01.824357 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-38684c37-86a2-4bf0-9280-94c70b0bc6e4 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:01.825043 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-38684c37-86a2-4bf0-9280-94c70b0bc6e4 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: 86ec5d65-dd6e-4578-ad1e-588cdf8cfa22] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:01.831645 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-38684c37-86a2-4bf0-9280-94c70b0bc6e4 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:01.832120 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-38684c37-86a2-4bf0-9280-94c70b0bc6e4 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:01.832545 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-38684c37-86a2-4bf0-9280-94c70b0bc6e4 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:01.833258 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-38684c37-86a2-4bf0-9280-94c70b0bc6e4 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:01.833708 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-38684c37-86a2-4bf0-9280-94c70b0bc6e4 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:01.834124 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-38684c37-86a2-4bf0-9280-94c70b0bc6e4 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:01.847687 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.wsgi [None req-38684c37-86a2-4bf0-9280-94c70b0bc6e4 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] HTTP exception thrown: Instance 86ec5d65-dd6e-4578-ad1e-588cdf8cfa22 could not be found. Aug 31 19:44:01.849292 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-38684c37-86a2-4bf0-9280-94c70b0bc6e4 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Request method failure captured: Aug 31 19:44:01.849292 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: request: GET /compute/v2.1/servers/86ec5d65-dd6e-4578-ad1e-588cdf8cfa22 HTTP/1.1 Aug 31 19:44:01.849292 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept: application/json Aug 31 19:44:01.849292 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Aug 31 19:44:01.849292 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Connection: close Aug 31 19:44:01.849292 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Length: 0 Aug 31 19:44:01.849292 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Type: application/json Aug 31 19:44:01.849292 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Host: 10.222.0.65 Aug 31 19:44:01.849292 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Aug 31 19:44:01.849292 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Aug 31 19:44:01.849292 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjD7gwsH5VZMgDMl8y6FqBAYLnx2bp0y0PQvT8fkHTtKVMRMP4627wc2dYH_-AmY882xS_-ikxkvQEb6iaN4jsJOISI0-mJVnI3lahzm92E-XvGDWpTlus5QtHjARTEwA34gIaA79Q59Exwol_DdqUyy0B6p3v8IRaEs5jHM8DclZMSm4 Aug 31 19:44:01.849292 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Aug 31 19:44:01.849292 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Aug 31 19:44:01.849292 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Aug 31 19:44:01.849292 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Aug 31 19:44:01.849292 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Aug 31 19:44:01.849292 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Aug 31 19:44:01.849292 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Id: 2f7614eeafc645958e7308586df90b8e Aug 31 19:44:01.849292 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-TestVolumeBootPattern-1556101958 Aug 31 19:44:01.849292 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Role: member,reader Aug 31 19:44:01.849292 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Roles: member,reader Aug 31 19:44:01.851239 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2f7614eeafc645958e7308586df90b8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2f7614eeafc645958e7308586df90b8e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2f7614eeafc645958e7308586df90b8e", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2f7614eeafc645958e7308586df90b8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:44:01.851239 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-TestVolumeBootPattern-1556101958 Aug 31 19:44:01.851239 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Id: 2f7614eeafc645958e7308586df90b8e Aug 31 19:44:01.851239 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-TestVolumeBootPattern-1556101958 Aug 31 19:44:01.851239 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User: tempest-TestVolumeBootPattern-1556101958-project Aug 31 19:44:01.851239 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Aug 31 19:44:01.851239 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Aug 31 19:44:01.851239 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Id: 8983f4ff039e4f6bbf01159accb1fb7c Aug 31 19:44:01.851239 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-TestVolumeBootPattern-1556101958-project Aug 31 19:44:01.851239 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: method: > Aug 31 19:44:01.851239 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: exception: Instance 86ec5d65-dd6e-4578-ad1e-588cdf8cfa22 could not be found. Aug 31 19:44:01.851239 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: action_args: {'id': '86ec5d65-dd6e-4578-ad1e-588cdf8cfa22'} Aug 31 19:44:01.852288 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:44:01.852288 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:44:01.852288 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:44:01.852288 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:44:01.852288 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:44:01.852288 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:44:01.852288 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:44:01.852288 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:44:01.852288 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:44:01.852288 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:44:01.852288 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86ec5d65-dd6e-4578-ad1e-588cdf8cfa22 could not be found. Aug 31 19:44:01.852288 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:44:01.852288 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:44:01.852288 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:44:01.852288 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:44:01.852288 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:44:01.852288 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:44:01.852288 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:44:01.852288 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:44:01.852288 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:44:01.854046 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:44:01.854046 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:44:01.854046 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:44:01.854046 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:44:01.854046 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:44:01.854046 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:44:01.854046 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:44:01.854046 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86ec5d65-dd6e-4578-ad1e-588cdf8cfa22 could not be found. Aug 31 19:44:01.854046 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:44:01.854046 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:44:01.854046 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:44:01.854046 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:44:01.854046 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:44:01.854046 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:44:01.854046 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:44:01.854046 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:44:01.854046 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86ec5d65-dd6e-4578-ad1e-588cdf8cfa22 could not be found. Aug 31 19:44:01.854046 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:44:01.855618 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-38684c37-86a2-4bf0-9280-94c70b0bc6e4 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Returning 404 to user: Instance 86ec5d65-dd6e-4578-ad1e-588cdf8cfa22 could not be found. {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:44:01.855618 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-38684c37-86a2-4bf0-9280-94c70b0bc6e4 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/86ec5d65-dd6e-4578-ad1e-588cdf8cfa22" status: 404 len: 111 microversion: 2.1 time: 0.031008 Aug 31 19:44:01.855618 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 662/1326] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:44:01 2022] GET /compute/v2.1/servers/86ec5d65-dd6e-4578-ad1e-588cdf8cfa22 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:44:04.906724 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-ac433078-3b22-4bd6-afbd-9d35fdfb655f tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:04.907213 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-ac433078-3b22-4bd6-afbd-9d35fdfb655f tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: bba8eb34-9578-4c3a-87be-44f0c9fcad5d] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:04.913667 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ac433078-3b22-4bd6-afbd-9d35fdfb655f tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:04.913858 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-6cddf822-0708-4bfa-8968-75d6fae96298 req-6ecd08fd-a9a7-4397-9fb4-920320e475c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bba8eb34-9578-4c3a-87be-44f0c9fcad5d", "tag": "f7163f92-b218-4fa7-a8b6-e22840f86ef5"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:44:04.914309 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ac433078-3b22-4bd6-afbd-9d35fdfb655f tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:04.914583 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ac433078-3b22-4bd6-afbd-9d35fdfb655f tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:04.915494 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ac433078-3b22-4bd6-afbd-9d35fdfb655f tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:04.915952 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ac433078-3b22-4bd6-afbd-9d35fdfb655f tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:04.916380 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ac433078-3b22-4bd6-afbd-9d35fdfb655f tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:04.923999 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-6cddf822-0708-4bfa-8968-75d6fae96298 req-6ecd08fd-a9a7-4397-9fb4-920320e475c4 service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:04.924681 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-6cddf822-0708-4bfa-8968-75d6fae96298 req-6ecd08fd-a9a7-4397-9fb4-920320e475c4 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:04.925414 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-6cddf822-0708-4bfa-8968-75d6fae96298 req-6ecd08fd-a9a7-4397-9fb4-920320e475c4 service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:04.937472 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-6cddf822-0708-4bfa-8968-75d6fae96298 req-6ecd08fd-a9a7-4397-9fb4-920320e475c4 service nova] Creating event network-changed:f7163f92-b218-4fa7-a8b6-e22840f86ef5 for instance bba8eb34-9578-4c3a-87be-44f0c9fcad5d on hv-cinder-83538 Aug 31 19:44:04.942825 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-6cddf822-0708-4bfa-8968-75d6fae96298 req-6ecd08fd-a9a7-4397-9fb4-920320e475c4 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032741 Aug 31 19:44:04.943225 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-ac433078-3b22-4bd6-afbd-9d35fdfb655f tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: bba8eb34-9578-4c3a-87be-44f0c9fcad5d] Going to try to terminate instance {{(pid=120623) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 19:44:04.943763 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 663/1327] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:44:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:44:05.023571 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-ac433078-3b22-4bd6-afbd-9d35fdfb655f tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "DELETE /compute/v2.1/servers/bba8eb34-9578-4c3a-87be-44f0c9fcad5d" status: 204 len: 0 microversion: 2.1 time: 0.120144 Aug 31 19:44:05.024506 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 665/1328] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 31 19:44:04 2022] DELETE /compute/v2.1/servers/bba8eb34-9578-4c3a-87be-44f0c9fcad5d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:44:05.033612 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-615ea5c6-c442-4faa-9a62-b0a278797c49 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:05.034493 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-615ea5c6-c442-4faa-9a62-b0a278797c49 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: bba8eb34-9578-4c3a-87be-44f0c9fcad5d] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:05.044359 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-615ea5c6-c442-4faa-9a62-b0a278797c49 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:05.045146 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-615ea5c6-c442-4faa-9a62-b0a278797c49 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:05.045779 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-615ea5c6-c442-4faa-9a62-b0a278797c49 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:05.047195 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-615ea5c6-c442-4faa-9a62-b0a278797c49 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:05.047901 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-615ea5c6-c442-4faa-9a62-b0a278797c49 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:05.048315 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-615ea5c6-c442-4faa-9a62-b0a278797c49 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:05.203632 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-615ea5c6-c442-4faa-9a62-b0a278797c49 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8983f4ff039e4f6bbf01159accb1fb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7614eeafc645958e7308586df90b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:44:05.211847 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-615ea5c6-c442-4faa-9a62-b0a278797c49 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/bba8eb34-9578-4c3a-87be-44f0c9fcad5d" status: 200 len: 1578 microversion: 2.1 time: 0.182786 Aug 31 19:44:05.219358 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 664/1329] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:44:05 2022] GET /compute/v2.1/servers/bba8eb34-9578-4c3a-87be-44f0c9fcad5d => generated 1578 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:44:06.234202 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d29e3cd5-f9ad-4991-98d6-24b7dc7419fe tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:06.234895 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d29e3cd5-f9ad-4991-98d6-24b7dc7419fe tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: bba8eb34-9578-4c3a-87be-44f0c9fcad5d] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:06.241539 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d29e3cd5-f9ad-4991-98d6-24b7dc7419fe tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:06.242080 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d29e3cd5-f9ad-4991-98d6-24b7dc7419fe tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:06.242631 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d29e3cd5-f9ad-4991-98d6-24b7dc7419fe tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:06.243329 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d29e3cd5-f9ad-4991-98d6-24b7dc7419fe tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:06.243780 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d29e3cd5-f9ad-4991-98d6-24b7dc7419fe tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:06.244198 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d29e3cd5-f9ad-4991-98d6-24b7dc7419fe tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:06.385024 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-d29e3cd5-f9ad-4991-98d6-24b7dc7419fe tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8983f4ff039e4f6bbf01159accb1fb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7614eeafc645958e7308586df90b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:44:06.393904 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-d29e3cd5-f9ad-4991-98d6-24b7dc7419fe tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/bba8eb34-9578-4c3a-87be-44f0c9fcad5d" status: 200 len: 1578 microversion: 2.1 time: 0.164005 Aug 31 19:44:06.394478 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 666/1330] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:44:06 2022] GET /compute/v2.1/servers/bba8eb34-9578-4c3a-87be-44f0c9fcad5d => generated 1578 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:44:07.312327 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-e410072e-241f-4dda-b753-c23d6784fa85 req-2d4e79f2-bf49-4413-b39d-e2df29aab23d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bba8eb34-9578-4c3a-87be-44f0c9fcad5d", "name": "network-vif-deleted", "tag": "f7163f92-b218-4fa7-a8b6-e22840f86ef5"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:44:07.323921 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-e410072e-241f-4dda-b753-c23d6784fa85 req-2d4e79f2-bf49-4413-b39d-e2df29aab23d service nova] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:07.324491 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-e410072e-241f-4dda-b753-c23d6784fa85 req-2d4e79f2-bf49-4413-b39d-e2df29aab23d service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:07.324913 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-e410072e-241f-4dda-b753-c23d6784fa85 req-2d4e79f2-bf49-4413-b39d-e2df29aab23d service nova] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:07.337038 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-e410072e-241f-4dda-b753-c23d6784fa85 req-2d4e79f2-bf49-4413-b39d-e2df29aab23d service nova] Creating event network-vif-deleted:f7163f92-b218-4fa7-a8b6-e22840f86ef5 for instance bba8eb34-9578-4c3a-87be-44f0c9fcad5d on hv-cinder-83538 Aug 31 19:44:07.342812 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-e410072e-241f-4dda-b753-c23d6784fa85 req-2d4e79f2-bf49-4413-b39d-e2df29aab23d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034491 Aug 31 19:44:07.343869 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 665/1331] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 19:44:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:44:07.414154 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-df70bc69-a303-4827-8c9c-ed357efca6c9 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:07.414840 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-df70bc69-a303-4827-8c9c-ed357efca6c9 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: bba8eb34-9578-4c3a-87be-44f0c9fcad5d] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:07.421920 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-df70bc69-a303-4827-8c9c-ed357efca6c9 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:07.422432 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-df70bc69-a303-4827-8c9c-ed357efca6c9 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:07.422869 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-df70bc69-a303-4827-8c9c-ed357efca6c9 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:07.423655 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-df70bc69-a303-4827-8c9c-ed357efca6c9 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:07.424197 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-df70bc69-a303-4827-8c9c-ed357efca6c9 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:07.424626 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-df70bc69-a303-4827-8c9c-ed357efca6c9 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:07.487901 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-df70bc69-a303-4827-8c9c-ed357efca6c9 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8983f4ff039e4f6bbf01159accb1fb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7614eeafc645958e7308586df90b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:44:07.495588 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-df70bc69-a303-4827-8c9c-ed357efca6c9 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/bba8eb34-9578-4c3a-87be-44f0c9fcad5d" status: 200 len: 1225 microversion: 2.1 time: 0.085156 Aug 31 19:44:07.496154 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 667/1332] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:44:07 2022] GET /compute/v2.1/servers/bba8eb34-9578-4c3a-87be-44f0c9fcad5d => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:44:08.518320 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-b581a133-b4a2-48fe-9acd-eba3ea585394 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:08.519023 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-b581a133-b4a2-48fe-9acd-eba3ea585394 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: bba8eb34-9578-4c3a-87be-44f0c9fcad5d] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:08.525777 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b581a133-b4a2-48fe-9acd-eba3ea585394 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:08.526261 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b581a133-b4a2-48fe-9acd-eba3ea585394 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:08.526691 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b581a133-b4a2-48fe-9acd-eba3ea585394 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:08.527376 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b581a133-b4a2-48fe-9acd-eba3ea585394 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:08.527826 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b581a133-b4a2-48fe-9acd-eba3ea585394 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:08.528275 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b581a133-b4a2-48fe-9acd-eba3ea585394 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:08.541345 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.wsgi [None req-b581a133-b4a2-48fe-9acd-eba3ea585394 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] HTTP exception thrown: Instance bba8eb34-9578-4c3a-87be-44f0c9fcad5d could not be found. Aug 31 19:44:08.542958 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-b581a133-b4a2-48fe-9acd-eba3ea585394 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Request method failure captured: Aug 31 19:44:08.542958 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: request: GET /compute/v2.1/servers/bba8eb34-9578-4c3a-87be-44f0c9fcad5d HTTP/1.1 Aug 31 19:44:08.542958 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept: application/json Aug 31 19:44:08.542958 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Aug 31 19:44:08.542958 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Connection: close Aug 31 19:44:08.542958 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Length: 0 Aug 31 19:44:08.542958 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Type: application/json Aug 31 19:44:08.542958 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Host: 10.222.0.65 Aug 31 19:44:08.542958 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Aug 31 19:44:08.542958 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Aug 31 19:44:08.542958 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjD7gwsH5VZMgDMl8y6FqBAYLnx2bp0y0PQvT8fkHTtKVMRMP4627wc2dYH_-AmY882xS_-ikxkvQEb6iaN4jsJOISI0-mJVnI3lahzm92E-XvGDWpTlus5QtHjARTEwA34gIaA79Q59Exwol_DdqUyy0B6p3v8IRaEs5jHM8DclZMSm4 Aug 31 19:44:08.542958 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Aug 31 19:44:08.542958 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Aug 31 19:44:08.542958 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Aug 31 19:44:08.542958 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Aug 31 19:44:08.542958 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Aug 31 19:44:08.542958 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Aug 31 19:44:08.542958 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Id: 2f7614eeafc645958e7308586df90b8e Aug 31 19:44:08.542958 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-TestVolumeBootPattern-1556101958 Aug 31 19:44:08.542958 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Role: member,reader Aug 31 19:44:08.542958 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Roles: member,reader Aug 31 19:44:08.544801 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2f7614eeafc645958e7308586df90b8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2f7614eeafc645958e7308586df90b8e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2f7614eeafc645958e7308586df90b8e", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2f7614eeafc645958e7308586df90b8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:44:08.544801 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-TestVolumeBootPattern-1556101958 Aug 31 19:44:08.544801 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Id: 2f7614eeafc645958e7308586df90b8e Aug 31 19:44:08.544801 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-TestVolumeBootPattern-1556101958 Aug 31 19:44:08.544801 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User: tempest-TestVolumeBootPattern-1556101958-project Aug 31 19:44:08.544801 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Aug 31 19:44:08.544801 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Aug 31 19:44:08.544801 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Id: 8983f4ff039e4f6bbf01159accb1fb7c Aug 31 19:44:08.544801 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-TestVolumeBootPattern-1556101958-project Aug 31 19:44:08.544801 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: method: > Aug 31 19:44:08.544801 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: exception: Instance bba8eb34-9578-4c3a-87be-44f0c9fcad5d could not be found. Aug 31 19:44:08.544801 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: action_args: {'id': 'bba8eb34-9578-4c3a-87be-44f0c9fcad5d'} Aug 31 19:44:08.545837 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:44:08.545837 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:44:08.545837 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:44:08.545837 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:44:08.545837 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:44:08.545837 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:44:08.545837 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:44:08.545837 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:44:08.545837 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:44:08.545837 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:44:08.545837 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bba8eb34-9578-4c3a-87be-44f0c9fcad5d could not be found. Aug 31 19:44:08.545837 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:44:08.545837 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:44:08.545837 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:44:08.545837 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:44:08.545837 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:44:08.545837 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:44:08.545837 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:44:08.545837 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:44:08.545837 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:44:08.547443 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:44:08.547443 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:44:08.547443 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:44:08.547443 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:44:08.547443 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:44:08.547443 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:44:08.547443 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:44:08.547443 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bba8eb34-9578-4c3a-87be-44f0c9fcad5d could not be found. Aug 31 19:44:08.547443 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:44:08.547443 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:44:08.547443 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:44:08.547443 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:44:08.547443 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:44:08.547443 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:44:08.547443 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:44:08.547443 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:44:08.547443 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bba8eb34-9578-4c3a-87be-44f0c9fcad5d could not be found. Aug 31 19:44:08.547443 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:44:08.548987 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-b581a133-b4a2-48fe-9acd-eba3ea585394 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Returning 404 to user: Instance bba8eb34-9578-4c3a-87be-44f0c9fcad5d could not be found. {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:44:08.548987 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-b581a133-b4a2-48fe-9acd-eba3ea585394 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/bba8eb34-9578-4c3a-87be-44f0c9fcad5d" status: 404 len: 111 microversion: 2.1 time: 0.030863 Aug 31 19:44:08.548987 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 666/1333] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:44:08 2022] GET /compute/v2.1/servers/bba8eb34-9578-4c3a-87be-44f0c9fcad5d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:44:08.992618 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-601158fd-4b92-4e97-97b5-c712830cd728 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:08.993122 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-601158fd-4b92-4e97-97b5-c712830cd728 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: e9c550c2-bc03-4e38-a7b7-3035d095deff] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:08.999270 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-601158fd-4b92-4e97-97b5-c712830cd728 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:08.999804 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-601158fd-4b92-4e97-97b5-c712830cd728 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:09.000235 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-601158fd-4b92-4e97-97b5-c712830cd728 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:09.000926 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-601158fd-4b92-4e97-97b5-c712830cd728 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:09.001408 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-601158fd-4b92-4e97-97b5-c712830cd728 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:09.001832 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-601158fd-4b92-4e97-97b5-c712830cd728 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:09.015436 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.wsgi [None req-601158fd-4b92-4e97-97b5-c712830cd728 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] HTTP exception thrown: Instance e9c550c2-bc03-4e38-a7b7-3035d095deff could not be found. Aug 31 19:44:09.017063 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-601158fd-4b92-4e97-97b5-c712830cd728 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Request method failure captured: Aug 31 19:44:09.017063 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: request: DELETE /compute/v2.1/servers/e9c550c2-bc03-4e38-a7b7-3035d095deff HTTP/1.1 Aug 31 19:44:09.017063 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Accept: application/json Aug 31 19:44:09.017063 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Accept-Encoding: identity Aug 31 19:44:09.017063 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Connection: close Aug 31 19:44:09.017063 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Content-Length: 0 Aug 31 19:44:09.017063 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Content-Type: application/json Aug 31 19:44:09.017063 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Host: 10.222.0.65 Aug 31 19:44:09.017063 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: Openstack-System-Scope: None Aug 31 19:44:09.017063 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: User-Agent: python-urllib3/1.26.12 Aug 31 19:44:09.017063 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Auth-Token: gAAAAABjD7gwsH5VZMgDMl8y6FqBAYLnx2bp0y0PQvT8fkHTtKVMRMP4627wc2dYH_-AmY882xS_-ikxkvQEb6iaN4jsJOISI0-mJVnI3lahzm92E-XvGDWpTlus5QtHjARTEwA34gIaA79Q59Exwol_DdqUyy0B6p3v8IRaEs5jHM8DclZMSm4 Aug 31 19:44:09.017063 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Domain-Id: None Aug 31 19:44:09.017063 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Domain-Name: None Aug 31 19:44:09.017063 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Identity-Status: Confirmed Aug 31 19:44:09.017063 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Is-Admin-Project: True Aug 31 19:44:09.017063 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Id: default Aug 31 19:44:09.017063 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Name: Default Aug 31 19:44:09.017063 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Id: 2f7614eeafc645958e7308586df90b8e Aug 31 19:44:09.017063 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Project-Name: tempest-TestVolumeBootPattern-1556101958 Aug 31 19:44:09.017063 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Role: member,reader Aug 31 19:44:09.017063 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Roles: member,reader Aug 31 19:44:09.018848 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2f7614eeafc645958e7308586df90b8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2f7614eeafc645958e7308586df90b8e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2f7614eeafc645958e7308586df90b8e", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2f7614eeafc645958e7308586df90b8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:44:09.018848 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant: tempest-TestVolumeBootPattern-1556101958 Aug 31 19:44:09.018848 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant-Id: 2f7614eeafc645958e7308586df90b8e Aug 31 19:44:09.018848 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-Tenant-Name: tempest-TestVolumeBootPattern-1556101958 Aug 31 19:44:09.018848 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User: tempest-TestVolumeBootPattern-1556101958-project Aug 31 19:44:09.018848 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Id: default Aug 31 19:44:09.018848 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Name: Default Aug 31 19:44:09.018848 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Id: 8983f4ff039e4f6bbf01159accb1fb7c Aug 31 19:44:09.018848 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: X-User-Name: tempest-TestVolumeBootPattern-1556101958-project Aug 31 19:44:09.018848 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: method: > Aug 31 19:44:09.018848 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: exception: Instance e9c550c2-bc03-4e38-a7b7-3035d095deff could not be found. Aug 31 19:44:09.018848 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: action_args: {'id': 'e9c550c2-bc03-4e38-a7b7-3035d095deff'} Aug 31 19:44:09.019796 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:44:09.019796 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:44:09.019796 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:44:09.019796 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:44:09.019796 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:44:09.019796 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:44:09.019796 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:44:09.019796 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:44:09.019796 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:44:09.019796 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:44:09.019796 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9c550c2-bc03-4e38-a7b7-3035d095deff could not be found. Aug 31 19:44:09.019796 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:44:09.019796 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:44:09.019796 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:44:09.019796 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:44:09.019796 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:44:09.019796 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:44:09.019796 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:44:09.019796 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:44:09.019796 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:44:09.021174 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:44:09.021174 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 19:44:09.021174 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 19:44:09.021174 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 19:44:09.021174 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 19:44:09.021174 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:44:09.021174 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:44:09.021174 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:44:09.021174 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:44:09.021174 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9c550c2-bc03-4e38-a7b7-3035d095deff could not be found. Aug 31 19:44:09.021174 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:44:09.021174 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:44:09.021174 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:44:09.021174 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:44:09.021174 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:44:09.021174 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:44:09.021174 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:44:09.021174 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:44:09.021174 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9c550c2-bc03-4e38-a7b7-3035d095deff could not be found. Aug 31 19:44:09.021174 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Aug 31 19:44:09.022643 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-601158fd-4b92-4e97-97b5-c712830cd728 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Returning 404 to user: Instance e9c550c2-bc03-4e38-a7b7-3035d095deff could not be found. {{(pid=120623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:44:09.022643 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-601158fd-4b92-4e97-97b5-c712830cd728 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "DELETE /compute/v2.1/servers/e9c550c2-bc03-4e38-a7b7-3035d095deff" status: 404 len: 111 microversion: 2.1 time: 0.029960 Aug 31 19:44:09.022643 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 668/1334] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 31 19:44:08 2022] DELETE /compute/v2.1/servers/e9c550c2-bc03-4e38-a7b7-3035d095deff => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:44:09.027904 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-10456a59-0320-48f0-9e91-d4ce021db53c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:09.028513 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-10456a59-0320-48f0-9e91-d4ce021db53c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] [instance: e9c550c2-bc03-4e38-a7b7-3035d095deff] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:09.034985 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-10456a59-0320-48f0-9e91-d4ce021db53c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:09.035461 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-10456a59-0320-48f0-9e91-d4ce021db53c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:09.035888 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-10456a59-0320-48f0-9e91-d4ce021db53c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:09.036563 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-10456a59-0320-48f0-9e91-d4ce021db53c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Acquiring lock "658714ec-07f2-4e1f-a605-05702ce30e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:09.037011 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-10456a59-0320-48f0-9e91-d4ce021db53c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:09.037500 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-10456a59-0320-48f0-9e91-d4ce021db53c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Lock "658714ec-07f2-4e1f-a605-05702ce30e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:09.050528 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.wsgi [None req-10456a59-0320-48f0-9e91-d4ce021db53c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] HTTP exception thrown: Instance e9c550c2-bc03-4e38-a7b7-3035d095deff could not be found. Aug 31 19:44:09.052016 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-10456a59-0320-48f0-9e91-d4ce021db53c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Request method failure captured: Aug 31 19:44:09.052016 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: request: GET /compute/v2.1/servers/e9c550c2-bc03-4e38-a7b7-3035d095deff HTTP/1.1 Aug 31 19:44:09.052016 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept: application/json Aug 31 19:44:09.052016 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Aug 31 19:44:09.052016 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Connection: close Aug 31 19:44:09.052016 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Length: 0 Aug 31 19:44:09.052016 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Content-Type: application/json Aug 31 19:44:09.052016 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Host: 10.222.0.65 Aug 31 19:44:09.052016 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Aug 31 19:44:09.052016 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Aug 31 19:44:09.052016 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjD7gwsH5VZMgDMl8y6FqBAYLnx2bp0y0PQvT8fkHTtKVMRMP4627wc2dYH_-AmY882xS_-ikxkvQEb6iaN4jsJOISI0-mJVnI3lahzm92E-XvGDWpTlus5QtHjARTEwA34gIaA79Q59Exwol_DdqUyy0B6p3v8IRaEs5jHM8DclZMSm4 Aug 31 19:44:09.052016 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Aug 31 19:44:09.052016 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Aug 31 19:44:09.052016 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Aug 31 19:44:09.052016 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Aug 31 19:44:09.052016 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Aug 31 19:44:09.052016 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Aug 31 19:44:09.052016 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Id: 2f7614eeafc645958e7308586df90b8e Aug 31 19:44:09.052016 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-TestVolumeBootPattern-1556101958 Aug 31 19:44:09.052016 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Role: member,reader Aug 31 19:44:09.052016 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Roles: member,reader Aug 31 19:44:09.053673 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2f7614eeafc645958e7308586df90b8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2f7614eeafc645958e7308586df90b8e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2f7614eeafc645958e7308586df90b8e", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2f7614eeafc645958e7308586df90b8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] Aug 31 19:44:09.053673 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-TestVolumeBootPattern-1556101958 Aug 31 19:44:09.053673 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Id: 2f7614eeafc645958e7308586df90b8e Aug 31 19:44:09.053673 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-TestVolumeBootPattern-1556101958 Aug 31 19:44:09.053673 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User: tempest-TestVolumeBootPattern-1556101958-project Aug 31 19:44:09.053673 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Aug 31 19:44:09.053673 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Aug 31 19:44:09.053673 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Id: 8983f4ff039e4f6bbf01159accb1fb7c Aug 31 19:44:09.053673 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-TestVolumeBootPattern-1556101958-project Aug 31 19:44:09.053673 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: method: > Aug 31 19:44:09.053673 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: exception: Instance e9c550c2-bc03-4e38-a7b7-3035d095deff could not be found. Aug 31 19:44:09.053673 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: action_args: {'id': 'e9c550c2-bc03-4e38-a7b7-3035d095deff'} Aug 31 19:44:09.054623 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:44:09.054623 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:44:09.054623 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:44:09.054623 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:44:09.054623 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:44:09.054623 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:44:09.054623 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:44:09.054623 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:44:09.054623 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:44:09.054623 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:44:09.054623 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9c550c2-bc03-4e38-a7b7-3035d095deff could not be found. Aug 31 19:44:09.054623 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:44:09.054623 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:44:09.054623 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:44:09.054623 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:44:09.054623 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:44:09.054623 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:44:09.054623 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:44:09.054623 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:44:09.054623 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:44:09.056360 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:44:09.056360 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:44:09.056360 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:44:09.056360 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:44:09.056360 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:44:09.056360 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:44:09.056360 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:44:09.056360 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9c550c2-bc03-4e38-a7b7-3035d095deff could not be found. Aug 31 19:44:09.056360 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:44:09.056360 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:44:09.056360 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:44:09.056360 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:44:09.056360 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:44:09.056360 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:44:09.056360 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:44:09.056360 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:44:09.056360 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9c550c2-bc03-4e38-a7b7-3035d095deff could not be found. Aug 31 19:44:09.056360 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Aug 31 19:44:09.058132 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-10456a59-0320-48f0-9e91-d4ce021db53c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Returning 404 to user: Instance e9c550c2-bc03-4e38-a7b7-3035d095deff could not be found. {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:44:09.058132 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-10456a59-0320-48f0-9e91-d4ce021db53c tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "GET /compute/v2.1/servers/e9c550c2-bc03-4e38-a7b7-3035d095deff" status: 404 len: 111 microversion: 2.1 time: 0.029385 Aug 31 19:44:09.058132 dv-cinder-835384-26-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 667/1335] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 19:44:09 2022] GET /compute/v2.1/servers/e9c550c2-bc03-4e38-a7b7-3035d095deff => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:44:10.348641 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d8137aa5-e601-4c21-abe3-bff5070c6c21 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] Calling method '.version_select at 0x7fdb86142820>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:10.373802 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-d8137aa5-e601-4c21-abe3-bff5070c6c21 tempest-TestVolumeBootPattern-1556101958 tempest-TestVolumeBootPattern-1556101958-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-735888209" status: 202 len: 0 microversion: 2.1 time: 0.029405 Aug 31 19:44:10.374271 dv-cinder-835384-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 669/1336] 10.222.0.65 () {58 vars in 1260 bytes} [Wed Aug 31 19:44:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-735888209 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)